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Abstract. We introduce the notion of an irreducible pair of elements in the 
first Weyl algebra W. Then we show that each endomorphism of W which is 
not an automorphism, can be transformed into one that applies the canonical 
generators of W onto an irreducible pair with a specific shape (subrcctangular). 
Consequently, the Dixmier conjecture is true if and only if there are no such 
irreducible pairs. 



Introduction 

The Weyl algebra A\ over a field K is the quotient of the free associative and unital 
if -algebra on two generators X, Y by the ideal generated by the relation [Y, X] = 1 . 
The Weyl algebra is the first of an infinite family of algebras, known as Weyl alge- 
bras, which were introduced by Hermann Weyl to study the Heisenberg uncertainty 
principle in quantum mechanics. The n-th Weyl algebra over K is the associative 
and unital if -algebra A n generated by the 2n variables Xi,Y±, . . . , X n , Y n , subject 
to the relations [X;, Xj] = [Y, Y}] =0 and [Y"i, Xj] — &y, where 8ij is the Kronecker 
symbol. 

In [8] Dixmier posed six problems, the first of which, also known as the Dixmier 
conjecture, was the following: is an algebra endomorphism of the Weyl algebra A\ 
on a characteristic zero field, necessarily an automorphism? This question makes 
sense for all the Weyl algebras, and in fact the generalized Dixmier conjecture claims 
that if char(if) = 0, then any endomorphism of A n must be an automorphism, for 
each n € IN. 

Currently, the Dixmier conjecture remains open even for the case n = 1. Some 
of the results in this topic are the following: In the early eighties, L. Vaserstein 
and V. Kac showed that the Dixmier conjecture implies the Jacobian conjecture 
(see [3], where this result is explicitly established). In 2005 the stable equiva- 
lence between the Dixmier and Jacobian conjectures was established by Yoshifumi 
Tsuchimoto [14], and the same result was obtained in an independent way in 2007 
by Alexei Belov-Kanel and Maxim Kontsevich [6] and by Pascal Kossivi Adjam- 
agbo and Arno van den Essen [2]. For a short proof of the equivalence between 
these two problems see [4]. In fact, in the [2] paper, there is also established the 
equivalence between the Dixmier conjecture and a similar conjecture about the 
endomorphisms of a family of Poisson algebras, that the autors call the Poisson 
Conjecture. Some other papers concerning the Dixmier conjecture in a direct or an 
indirect way are [5], [7] and [16]. 

In this work we deal with the case n = 1. From now on we write W (by Weyl) 
instead of Ay. A pair (P, Q) of elements of W is said to be irreducible if it is the 
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image of the pair (X, Y) of the canonical generators of W via an endomorphism 
which is not an automorphism, and it cannot be made "smaller" (in a sense that is 
established in detail in Definition 3.1) via automorphisms. Following the strategy 
of describing the generators of possible counterexamples, we prove the following 
result (Corollary 5.12): If the Dixmier conjecture is false, then there exist and 
irreducible pair (P, Q) such that the support of both P and Q is subrectangular 
(see Definition 1.5). This shape is the same achieved in the case of the Jacobian 
Conjecture (see for example [15, Corollary 10.2.21]). 

In [8], the author uses in some proofs the geometric properties of the support 
of certain elements. In this paper we exploit such geometric properties. For each 
(p, a) 6 Z 2 such that gcd(p, a) = 1 and p + a > we consider the (p, (revaluation 
v p _ a introduced in [8]. One of the ingredients used by us is the concept of "leading 
term" £ Pj(T (P) of an element P of W with respect to the (p, <j)-valuation, which 
in [8] is called the (p, cr)-polynomial associated with P. In Proposition 1.9 we 
reprove some of the multiplicative properties of £ Pia (P), which are found partially 
in [8, Lemma 2.4]. Furthermore, in Definition 1.15, we introduce the notion of 
(p, cr)-bracket of a pair (P, Q) of elements of W, which, when it is non zero, coincides 
with the (/?, tr)-polynomial associated with the commutator [P, Q] . 

Our basic idea is to associate a polynomial ,fp. p . a in one variable with £ Pi(T (P). 
On one hand this permits us to reprove some results of [8, Lemma 2.7] in Theo- 
rem 1.22 and, on the other hand, to write the (p, cr)-bracket [P, Q] Pt(T as an expres- 
sion of fp, Jq and its derivatives. This allows us to show that the (p, cr)-leading 
terms of the components of an irreducible pair (P, Q) must satisfy a very restrictive 
condition (Theorem 4.5): All irreducible factors of fp, P ,a and /q, P) ct are factors of 
the polynomial fF. p . a , associated with a (p, (r)-homogcncous element F £ W with 
(p, (revaluation p + a. Then, using elementary automorphisms we can "cut" the 
form of the support of the components of an irreducible pair until they have the 
desired subrectangular shape. In the last section we "cut" the support further, and 
this allow us to prove that 

B := min{gcd(vi i i(P), Ui,i(<3)), where (P,Q) is an irreducible pair} 

is greater or equal to 9. The equivalent result for Jacobian pairs was proved by 
Nagata in [12], [13], based on a work of Appelgate and Onishi ([1]). 

In general, the results about the shape in the commutative case and our case are 
very similar. We will compare the constructions described in [15] with ours. In the 
commutative case t p . a {P) is called P+ and the bracket corresponds to the Jacobian 
of P + ,Q + . This is a bit simpler than our notation, but ignores the relation be- 
tween the different valuations (called directions in [15]). Our Theorems 4.3 and 4.5 
give an improved version of the corresponding result for the Jacobian conjecture, 
established in [15, Proposition 10.2.8]. On the commutative case, we also have the 
idea of a polynomial in one variable, for example in [15, Lemma 10.2.12], although 
this idea is not used in the proof of [15, Proposition 10.2.8], but is used in the 
proof of [15, Corollary 10.2.21]. The differential equation for the polynomials in 
item (1) of our Theorem 1.22 is also found partially in the definition of p(z) before 
Lemma 10.2.13 in [15, page 250], but its importance is not fully noted. 

In a forthcoming paper we will cut the subrectangular support further, which 
finally will leave very few possible shapes of irreducible pairs. In particular, we will 
improve the lower bound for the size of the support, and show a way to find possible 
counterexamples. If the same machinery works in the commutative case, it will 
improve substantively the lower bound for the degree of possible counterexamples 
established in [11], where it is shown that the degrees of the components P and Q 
of a Jacobian pair must be greater than 100. 



THE DIXMIER CONJECTURE AND THE SHAPE OF POSSIBLE COUNTEREXAMPLES 3 



1 Preliminaries 

In this paper if is a characteristic zero field, W is the Weyl algebra on K, that 
is the unitary associative if-algebra generate by elements X, Y and the relation 
[Y, X] = 1. Let L :— K[x,y] be the polynomial if- algebra in two variables and let 
W ->• L be the if -linear map defined by := x i y j . Let 

2J := {(p, cr) £ Z 2 : gcd(p, a) = 1 and p + cr > 0} 

and 

23:={(/9,cr) 6 2J:p + cr>0}. 
Note that 5J = 53 U {(1, -1), (-1, 1)}. 

Definition 1.1. For all (p, a) G 9J and (i, j) £ZxZ we write 

v p ,„(i,j) := pi + aj. 
Notations 1.2. Let (p, a) e 2J. For P = £ a^V G L \ {0}, we define: 

- The support of P as 

Supp(P) :={(*,j):o ij -^0}. 

- The (p,<r)-degree of P as v Pi(T (P) := max j) : a»j 7^ 0}. 

- The (p, a)-leading term of P as 

4, CT (P) := ^ dijxY. 

{pi+aj=v PlCr (P)} 

- w(P) := (io,io — ui,-i(-P)) such that 

« = max{« :(«,«- i>i ,-i(P)) £ Supp(4,-i(-P))} , 

- 4(P) := a io j , where (i , jo) =w(P). 

- £ t (P) := a iojo x io yi°, where (i , jo) = w(P). 

- w(P) := (io — V-i t i(P), io) such that 

i = max{i : (i - u_i i i(P),i) G Supp(f _i ; i(P))} , 

- 4(-P) == ffliojoi where (io, Jo) =w(P). 

- £t{P) ■= Oiojo^y 30 ' where (io, jo) = W(P). 
Notations 1.3. Let (p, cr) G 2T. For P 6 VF \ {0}, we define: 

- The support of P as Supp(P) := Supp(*(P)) . 

- The (p,cr)- degree of P as ^, CT (P) := v Pi<T (^(P)). 

- The (p, a)-leading term of P as 4, CT (P) := l p , a (*(P)). 

- tu(P) := tu(#(P)). 

- 4(P) :=4(*(P)). 

- i t (P) := 4(P)^ t0 ^°, where (*„, j ) = w(P). 

- uJ(P) := w(*(P)). 

- 4(P) :=4(*(P)). 

- 4(P) :=4(P)^ i0 ^°, where (i , j ) = w(P). 

Notation 1.4. We say that P G L is (p, a) -homogeneous if P = or P = i p ^{P). 
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Definition 1.5. We say that P € W is subrectangular if its support is contained 
in a rectangle who's farthest edge belongs to Supp(P). This means that there is 
(*Oiio) £ Supp(P) such that each € Supp(P) fulfills « < io and j < jo- In 

other words that (io,jo) £ Supp(P) and that the support of P is contained in the 
rectangle whose vertices are (0,0), (0, jo), (io,0) and (i , jo)- Furthermore we will 
say that P G W is subsquare if i = jo- 

Definition 1.6. Let (p, a) e 2J and let P e W \ {0}. 

- If (p, a) (1, —1), then the starting point of P with respect to (p, a) is 

st p ^(P)=w(£ Pia (P)). 

- If (p, a) 7^ (— 1, 1), then the end pomi o/ P wii/i respect to (p, a) is 

en p , CT (P) = w(^, CT (P)). 

Note that eni ,_i(P) = w(P) and st_ M (P) = w(P). 




5 X 



Illustration of some concepts introduced 
in Notation 1.3 and Definition 1.6 for 



P =X A 



X 1 



X°Y + XY* + X°Y 



e v 3 



+ X 3 Y 4 + IF 6 + X 4 Y 6 + X 2 Y 7 
and (p,o-) = (3,2). In this example 
e p ,„(P)=x 6 y 3 



4 6 

x y . 



Figure 1 



Lemma 1.7. It is true that 

i ,./., 

J \ I \ vi — k\sj — k 

Proof. It follows easily using that 

[Y, X*] = iX i ~ 1 , [Y^X 1 ] = [Y.X^- 1 +Y[Y j -\X 1 } 
and an induction argument. □ 
For j £ Z, we set 

Wj := {P E W \ {0} : P is (1, -l)-homogeneous and Ui,-i(P) = j} U {0}. 

Remark 1.8. It is easy to see that Wj is a subvector space of W. Moreover, 
by Lemma 1.7, we know that IF is a Z-graded algebra with Wj the (1,-1)- 
homogeneous component of degree j, and by [9, Lemma 2.1], we know that Wq = 
K[XY], and hence commutative. 

Proposition 1.9. Let P, Q € W \ {0} and (p, a) E 9J. The following assertions 
hold: 

(1) w(PQ) =w(P) + w(Q) andw(PQ) = w(P) + w(Q). In particular PQ ^ 0. 

(2) t P APQ) = e P A p )* P AQ) f° r al1 (p^) e 

(3) v p ^(PQ) = v p ap) + vpAQ) f° r al1 (p> a ) e 
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(4) st p ^(PQ) = st„, ff (P) +st PiU (Q) for all (p,a) G 23. 

(5) cupAPQ) = cn p .a(P) + en Pi(7 (Q) for all (p,a) G 23. 
The same properties hold for P,Q G L\ {0}. 

Proof. For P, Q G VF \ {0} this follows easily from Lemma 1.7 using that p + a > 
if (p, a) G 23. The proof for P, Q G L \ {0} is easier. □ 



en M (PQ) 




Illustration of Proposition 1.9 with 

sti.i (PQ) p =x 3 y + x 4 y 3 + x 2 y 5 + r 5 + xy 

and 

Q =X 3 Y 2 + X 2 Y 3 + XY 3 + X 2 Y 2 . 



X 

Figure 2 



By definition the cross product of two vectors A = (01,02) and B — (61,62) in 
R 2 isAxP:=det(fc 1 1 fc 2 2 ). 

Definition 1.10. We say that two vectors A and B in K 2 are aligned, if A x B = 0. 

Definition 1.11. Let P,Q G L \ {0}. We say that P and Q are aligned and write 
P ~ Q, if u>(P) and w(Q) are so. Moreover we say that P, Q <E W \ {0} are aligned 
if (P) ~ Note that 

- By definition P ~ Q if and only if £1 ,_i(P) - 

- ~ is not an equivalence relation (it is so restricted to {P : w(P) ^ (0,0)}). 

- If P - Q and w(P) ^ (0, 0) ^ w(Q), then tu(P) = \w(Q) with A > 0. 

Proposition 1.12. Let P,Q G W \ {0}. The following assertions hold: 

(1) IfP*>Q, then 

[P,Q]^0 and w([P,Q}) = w(P) + w(Q) -(1,1). 

(2) //w(P) ^ «7(Q), tfien 

[P,Q]^0 and «J([P,Q]) =tU(P)+tU(Q)-(l,l). 

Proof. We only prove item (1) since item (2) is similar. Let w(P) = (r, s) and 
W {Q) = i u i v )- Since (*) (") — (") Q = (r, s) x (w, v) ^ 0, using Lemma 1.7 one can 
check that 



tt([P,Q]) 



- : (P)e c (Q)X r+u - L Y 



r-\-u— 1 \rs+v— 1 



So,u;([P,Q])=u;(P)+u;(Q)-(l,l). 

Remark 1.13. For all P, Q G VF \ {0} and each (p, <r) G 23, we have 

[P,Q]=0 or ^, CT ([P,Q]) <^, CT (P)+v p , CT (Q)-(p + a). 



□ 
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Y 



w([P,Q}) 



w(P) 



w(P) 



w(Q) 



w([P,Q]) =w(P)+w(Q) -(1,1) 
and 

W([P,Q}) =W(P)+W(Q) -(1,1). 



w([P,Q}) 



X 



Figure 3. Proposition 1.12. 



[P,Q] P ,* = 



Definition 1.14. Let (p,a) G 23 and P,Q eW\ {0}. We say that P and Q are 
(p, cr) -proportional if [P, Q] = or v Pj(T ([P, Q]) < v p ,<x(P) +u (0 , o -(<2) - + 

Definition 1.15. For (p,a) G 23, we define 

[- -W: (W\{0}) x (W\{0})^L, 

by 

1 if P and Q are (/?, er)-proportional, 

I ^p,a{[P, Q]) if P and Q are not (p, er)-proportional. 

Lemma 1.16. Lef (p, er) G 23 and Zet P and Q fee {p, a) -homogeneous elements of 
W\{0}. 

(1) Ifw{P)oo W (Q), then [P,Q] ^0 and w([P, Q}) = w(£ p ^([P, Q})) . 

(2) Ifw(P) oo w{Q), then [P, Q] ± and «J([P, Q]) = «j(£ p , CT ([P, Q])) . 
Proof. We only prove item (1) since item (2) is similar. Write 

a (S 

P = J2 >>iX Ma Y s+lp and Q = J2 VjX u - ja Y v+jp , 

i=0 j=0 

with X , \ a , Po, t 1 ^ 7^ 0. Since, by Lemma 1.7, 

.Y'V '.Y'Y' = ^fc!( •? U ! \x i+i '- k Y j+1 '- k , 



k=0 



k \k 



we obtain that 

a /3 max{s+ip,«+jp} 

i p 'Q] = J2Yl J2 \ l p J c tJk x r+u -^+^ a - k Y s+v+ ^ + ^ p - k , 

where 

— < s r) cr)- «ct*)( r v 

Now, since w(P) w(Q), we have cooi 7^ 0. Consequently, since p + cr > 0, 

wipqd = EE^^^ r+ " (,+,) "V +8+((,+,)rl 

i=0 j"=0 
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Using again that cooi ^ 0, we obtain that 

w([P, Q]) = (r + u-l,s + v-l) = w{l P A\ p Q})), 

as desired. 



□ 



Proposition 1.17. Let P,Q,R G W\ {0} such that [P,Q] P ^ = £ p , a (R), where 
(p, a) G 53. We have: 

(1) Ifst P .a{P) *& P AQ)> then 

St p>a {P) + Bb p>a (Q) - (1, 1) = Bt p , a (R). 

(2) If cn p . a (P) oo cn p . a (Q), then 

en P)CT (P) + cn p , (T (Q) - (1, 1) = cn p . a (R). 



en 2 ,i(i?) 




st2,i(<3) = en 2 ,i(<9) 



Figure 4. Proposition 1.17. 



Proof. We only prove item (1) and leave the proof of item (2), which is similar, to 
the reader. Let Pi and Qi be (p, er)-homogeneous elements of W \ {0}, such that 



v P A p - p i) < v pA p i) and v pAQ - Qi) < vpAQi)- ( L1 ) 



Since 



[P,Q] - [P u Qi] + [Pi,Q-Qi] + [P-Pi,Q], 

and, by Remark 1.13, we have 

v P Ai p uQ - Qi}) < v P APi) + vpAQ - Qi) -(p + °) 
< v P A p i) + vpAQi) -(p + <j ) 
= v p ap) + v p AQ)-(p + v) 

and 

v p A\p -PuQ})< vpA p ) + ^AQ) - (p + *)> 

it follows from the fact that P and Q are not (p, cr)-proportional, that 

v P A[P, Q] - [PuQi]) < v„A[p, <?])• (i-2) 

Note that (1.1) and (1.2) imply 

t P A p ) = tpA p A tpAQ) = t P AQi) and tpA[ p >Q]) = tpA[ p i>Qi])- 
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Consequently, by item (1) of Proposition 1.12 and item (1) of Lemma 1.16, 
st p , CT (P) + st p , a (Q) - (1, 1) = st Pl(J (Pi) + st p , CT (Qi) - (1, 1) 

= w(P 1 ) + w(Q 1 )- (1,1) 
= w([P 1 ,Q 1 ]) 

= w(t p , a ([Pi,Qi])) 

= w(£ p , a ([P,Q])) 

= w(t p , a (R)) 
= st p . a (R), 

as desired. □ 
Proposition 1.18. Let (p, a) G QJ and P,Q G W \ {0}. If 

a (3 

wii/i Ao, A a , jiQ, fip 7^ ; then 

[p,Q] P ,a = J2 x i»i c ii xr+u ~ {i+j)a ~ 1 y s+v+(i+j)p ~ 1 > 

where Cij = (u — ja, v + jp) x (r — zer, s + zp) . 
Proof. Write 

P = X l X r - la Y s+lp + R P and Q = ^ + i? Q . 

i=0 j=0 

Since P P = or v p ^(R P ) < v Pt<T (P), and i?g = or v p ^(R Q ) < v p><T (Q), from 
Remark 1.13 it follows that 

a [3 

[P, Q] = J2J2 A ^ [X r - la Y s+tp ,X u -^Y v+:jp ] + R, (1.3) 

i=0 j=0 

where P = or v p ^(R) < v PiCr (P) + v Pt<T (Q) — (p + a). Now, since p + a > and 
by Lemma 1.7, 

we obtain that 

\^X r ~ ia Y s+ip X u ~' jrT Y v ^3P^ = djX r + u ^( i +j)< y ^ 1 Y s+v+ ^ i+ ^ p ^ 1 + Pjj (1 4) 

withPy = or v P)a (Rij) < v P!<T (P) + v p><7 (Q) - (p+a). Combining (1.3) with (1.4), 
we obtain that 

a S3 

[P, Q]=EE K^ ] X r+u - { - l+ ^ a - 1 Y s+v+ ^ p - 1 + RpQ, 

where P PQ = or v p ^(R PQ ) < v p . a (P) + v p . a (Q) - (p + cr). Since 

v p ,a ^X r+u -^+^- 1 Y s+v +^ p - 1 ) = v„, a {P) + v p , a {Q) ~ (P + <t), 

the result follows immediately. □ 

Corollary 1.19. Let (p,a) G 23 and P, P u Q,Qi G W \{0}. If t P A p ) = £ P A p i) 
andi p AQ) =t P ,<r(Qi)> then [ P iQ\p,o = [ p uQi] P ,a- 

Proof. Clear from Proposition 1.18. □ 
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Definition 1.20. Given P E L \ {0} and (p, a) E 23, we write 

7 

!p., P .a :=^2aiX l E K[x], 

i=0 

if 

7 

Z p><T (P) = a t x r - ia y s+lp with a ^ and a 7 ^ 0. 

Now, for P E W we set /p, p , CT := /*(p) lP , CT - Note that 

st Pl<7 (P) = (r,s), en p , CT (P) = (r - 7(T,s + 7p) (1.5) 

and 

e p , a (p) = x r y a f P , p , <T (x-< r y<>). (i-6) 

Remark 1.21. Let (p, er) € 23. From Proposition 1.9 it follows immediately that 

fpq, P ,a = fp, P ,af Q , P ,, for P,QG W\{0}. (1-7) 
The same result holds for P, Q e L \ {0}. 

Item (2) of the following theorem justify the terminology "(p, cr)-proportional" 
introduced in Definition 1.14. 

Theorem 1.22. Let (p, a) E 23, P, Q € W \ {0}, a := u P)CT (Q) and b := u p , CT (P). 

(1) // [P, Q] p ,cr 7^ 0, i/ien there exist h > and c e Z, suc/i i/iat 

xh f[P.,Q\ = cfpfQ + axf'pfQ - bxf' Q f P , 
where f P := fp >p><7 , Jq := /q, p ,<t a^d / [Pj q] := /[p,q], Pi<7 . 

(2) // [P, <5] PjC r = and a, b > ; iften i/iere exist Ap, Aq e P x , ra,nel swift 
gcd(m, n) = 1 and a (p, <r) -homogeneous polynomial R E L, such that 

777 b 

- = -, £ P , CT (P) = A P p ro ^ £ P AQ) = ^QR n - 

n a 

Proof. Write 

a 

£ P AP) = J2 Xixr ~ ia y s+ip and v(Q) = E^"~ J V +j> , ( L8 ) 

i=0 j=0 

with Ao,A Q ,po,P^ 7^ 0. By Proposition 1.18, 

[P,Q] Plff = ^2\ i ^c ij x r+u -^- 1 y s+v+{i+j)p - 1 , 
where := (u — j<7, tj + jp) x (r — icr,s + ip). Set 

P . — ^ ^ XifAjCijX ^ . 

ij 

Note that if [P,Q] p ,a = 0, then P = 0, and if [P,Q\ p , a ± 0, then P = x h f [P , Q] , 
where ft is the multiplicity of x in P. Let 

a := (u, v) x (—er, p), 6 := —(—a, p) x (r, s) and c := (u, u) x (r, s) 

Clearly 

Cij = c + ia-jb, a = v p ^(Q) and b = v p , a (P). 

Since 

^XifijX 1 ^ = f P f Q , ^iXiUjX 1 ^ = xf'pf Q and jXifijX 1 ^ = xf' Q f P , 
we obtain 

P = c/p/q + axf P f Q - bxf' Q f P . (1.9) 
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Item (1) follows immediately from this fact. Assume now that [P, Q] p , a = 0. In 
this case F = and, in particular, c = c o = -pT^ = 0. Hence, (1.9) becomes 

af'pfQ - bf Q f P = 0. 

Since a,b G IN, this implies = and so ff, = A/g for some X e K x . 

Hence, there are g £ K[x] and \p,\q E K x , such that 

/p = A P3 m and f Q = \ Q g n , (1.10) 

where m := scd ^ a ^ and n := gcd ° a ^ . Now, note that {(s, — r), (p, <r)} is a basis of 
Q x Q as a Q- vector space, since 

(s, -r) x (p, er) = (r, s).(p, er) = ^(P) = a > 0, 

where the dot denotes the usual inner product. Hence, from 

b(u, v).(s, —r) — b(u, v) x (r, s) = be = = a(r, s).(s, — r) 

and 

6(u, «).(/?, er) = v PitT (P)v PitT (Q) = v Pt(T (Q)v p , a (P) = a(r, s).(p, er), 

it follows that b(u,v) — a(r, s). Consequently m(u, v) = n(r, s), and so there exists 
(p, q) £ No x N , such that 

(u, v) = n(p, q) and (r, s) = m(p, q). (1-H) 

Write now g — Y^l=o l/ i xl w ith v 1 ^ 0. Since, by (1-8), (1-10) and (1.11), 

rym — a, pm — r and qm = s, 

we have 

r - aa s + an 

p — -f<7 = > and q + "fp = > 0. 

m ' m 

Consequently 

i=0 

is a polynomial which, by (1.10), fulfills 

e p , a (P) = x r y s f P (x-°yP) = \ P {xPy"g(x-yf)) m = \pR m 

and 

tpAQ) = x u y v fQ{x-°y p ) = a q (x p /#-'/))" = \ Q n n , 

as desired. □ 

Definition 1.23. Let k e IN, j e N , e, b > and c e Q. Wc say that a pair (/, g) 
of polynomials in K[x] satisfies PE(fc, j, e, b, c) if there is some h € No, such that 

x h f k+j = cfkg + ax{f ky g _ bxg/f k (L12) 

is fulfilled, where a = f & + e. 

Note that in equation (1.12) each irreducible factor of g that does not divide xf 
has multiplicity 1. 

Proposition 1.24. If(f,g) satisfy PE(k,j,e,b,c) and /(0) =^ ^ g(0), then each 
irreducible factor u of f , with multiplicity m u in f, has multiplicity jm u + 1 in 
g. Consequently g — fig for some g e K[x] separable and the number of different 
irreducible factors of f is lower or equal than the degree of g. 
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Proof. We can assume that K is algebraically closed. Take an irreducible monic 
factor u of /. Since /(0) ^ 0, there exists d G fc x such that u = x + d. Write 
/ = u s f and g = u r g, with r,s£H such that u does not divide fg. Now 

/' = su s - l u'J + u s j' and g' = ru^u'g + u r g' , 

and so (1.12) reads 

x hJ k +j u s(k+j) = u r+ks-l( aks _ br ) xu >J k g + u r+ksj k -l (J Vc + kaxV J> _ bx Jg'y 

We claim that (aks — br) ^ 0. In fact, on the contrary s(k + j) > r + ks and so 
sj > r. Since e, b,s,k> 0, this leads to the contradiction 

aks — br = (^jd> + e^j ks — br = kse + b(js — r) > kse > 0. 
k 

Since u does not divide xu' f g, we have s(k + j) = r + ks — 1. That is r = js + 1, 
which proves the first assertion. The remainding assertions now follow easily. □ 

Lemma 1.25. Let C, E G W \ {0}, m G IN and (p, a) G 23. // [C, E] ^ 0, then 

[C7 m , E] and £ P ^([C m , E]) = ml p , a (C) m - x l p , a (\C, E\). 

Moreover [C m , E] Pi<T ^ if and only if [C, E] Pt<T + 0. 

Proof. Since 

m— 1 

[C m ,E] = C'iC^p" 1 -' 1 - 1 

i=0 

and, by Proposition 1.9, 

e p , a (c l [c, e\ cr-*- 1 ) = v (C)™- 1 ^,, ( [c, £] ) , 

we have 

e p ,„([C m ,E}) = ml Pia (C) m -H p , a {[C,E\), 
In order to prove the last assertion note that, again by Proposition 1.9, 

v Pt(r ([C m ,E}) = v p , a (C m ) + v p A[C,E]) - v Pt<T (C), 

and so 

v p , a ([C m , E]) = v p AC m ) + v p , a {E) -(p + a) 

if and only if 

v Pl<r ([C, E]) = v Pi(T (C) + v p , a (E) -(p + a), 
which by Definition 1.15, means that [C m , E] p ^ / «■ [C, ^ 0. □ 

Theorem 1.26. Let C, D G W \ {0} with v p , a (C) > 0, where (p,a) G 23. 7/ 

[C fe , = ^, CT (C fe+J ) /or some fc e IN and j € IN 07 (1.13) 

i/ien i/iere exists a (p, a) -homogeneous element E G W, such that 
[C t ,E] p ^=U p ^(C t ) for all t& If. 

Proof. By equation (1.13) and items (1) and (2) of Proposition 1.9, we have 
(k+j)v p ,„(C) = kv p ^(C)+v p ^(D) -(p + a) and l p ,„([C k , D\) = e p , a (C k+j ), 
and so, 

Vp,a(D)=jv Pt(T (C)+p + a and f[ C *,D],p,a = fc k +i, P ,a- (1-14) 
Hence, by item (1) of Theorem 1.22 and equality (1.7), there exist hGffo and ceZ, 
such that 

x h fk+j = cfkg + ax{f ky g _ bxf k g ^ 
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E = £p,a{E) 

Figure 5. Theorem 1.26. 



where 

f ■= fc,p,<r, 9 ■■= fD, P ,v, a-~v p . a (D) and b := v p ^(C k ) = kv Pi!7 (C). 
Note that, since 

j 

a = —b + p + a, 

K 

the pair (/, g) fulfills PE(fc,j, e, b, c), where e := p + a. By Proposition 1.24 there 
exists g 6 K[x] such that g — fig. Set a := deg/, /3 := degg and write 

a 



i=0 



i=0 



with Ao, \ a ,po,Hi3 7*= 0. By item (2) of Proposition 1.9, 

(a \ k ka 
i=0 / i=0 

with each Aj 6 if. Let 7 := j3 — ja be the degree of g and write g — J2]=o Vi^- 
Note that 770 # 0, since / J (0)770 = f j {0)g{0) = g(0) ^ 0. We define 

7 

We claim that E EW. For this it suffices to check that 

u — jr > 0, v — js > 0, u — jr — 70- > and w — js + 7P > 0. 
In order to prove the two first inequalities, we consider the two cases 

st P A D ) ~ stp )(T (C) and st Pi0 .(D) stp )<7 (C). 
Note that (r, s) 7^ (0,0), since 

rp + scr — v p ^(C) > 0, 

and similarly (w,v) 7^ (0,0), since by the first equality in (1.14), 

up + va = v p ^(D) = jv p ^(C) + p + a>p + (T>0. 

Hence, by the last comment in Definition 1.11, if st Pj(T (-D) ~ st p o .(C), then there 
exists A > such that 

(u,v) = st Pt<T (D) = Astp )(T (C) = A(r,s). 

Consequently, again by the first equality in (1.14), 

jv P A C ) + P + o = v P A D ) = v p A^pA d )) = >MpA si pA C )) = Xv p-^(C), 
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which implies A > j, since v p<rT (C) > and p + a > 0. But then 

u — jr = (A — j)r > and v — js = (A — j)s > 0. 

Assume now that st Pya (D) st P;(T (C). Then 

st„,„(£>) oo st p , ff (C fc ), 

since st Pj(T (C fe ) = kst p _ a (C) by item (4) of Proposition 1.9. Hence, equality (1.13), 
Proposition 1.17 and item (4) of Proposition 1.9 yields 

st^p) + k st„ I<r (C) - (1, 1) = (k + j) st P;(7 (C), 

which implies (w, v) — j(r, s) + (1, 1), and so 

u — jr = 1 > and v — js = 1 > 0. 

For the two last inequalities, we consider the two cases 

en Pj(T (L>) ~ en PjCT (C) and en P;Cr (£>) * en p>cr (C). 

Note that (r — aa, s + ap) ^ (0, 0), since 

(r - aa)p + (s + ap)a = v p ^(C) > 0, 

and similarly (u — (3a, v + (ip) ^ (0, 0), since 

(u - 13a) p + (v + (3p)a = v p ^{D) = jv p ^(C) + p + a>p + a>0. 

Hence, if en P;(T (D) ~ en p , a (C), then arguing as before we obtain A > such that 

(u - (3a, v + j3 p) = cn PjCr (£>) = Xcn PiCr (C) = A(r - aa, s + ap). 

Consequently 

jv p ,a{C) + p + a = v p . a (D) = v p . a (cn p . a (D)) = Au PiCT (en Pi(7 (C)) = Xv p . a (C)), 
which implies A > j, since v p , a (C) > and p + a > 0. But then 

u — jr — 7<r = u — jr — (j3 — ja)a = u — f3a — j(r — aa) = (A — j)(r — aa) > 
and 

v — js + 7p = v — js + (/? — ja)p = v + j3p — j(s + ap) = (A — j)(s + ap) > 0. 

Assume now that en p , a (D) cn PiCr (C). Then 

en p . a (D) * en Piff (C fe ), 

since en P;(T (C fc ) = A:en p , cr (C) by item (4) of Proposition 1.9. Hence Proposition 1.17 
yields 

en PiCT (L>) + kcn p . a (C) - (1,1) = (k + j) en Pi<7 (C), 
which implies (u — (3a, v + (3p) — j(r — aa, s + ap) + (1,1), and so 

u — jr — "fa = 1 > and v — js + "fp = 1 > 0. 

Now, since 770 7^ and r/ 7 ^ 0, we have g = fi E . Consequently, by Proposi- 
tion 1.9 and the comment in Definition 1.20, 

t p , a {j^ec^j =i p , a Qs) i. P Acy 

= x u -^y v -^g(x-yP) (x r y s f {x~° y))* 
= x u y"g(x-yP) 

= t P A D )- 

Hence, by Corollary 1.19, equality (1.13) and item (2) of Proposition 1.9, we have 
C\ ^EC j ] - [C\B\ p . a = i P AC k+1 ) - i P AC) k+] - (1-15) 



14 



JORGE A. GUCCIONE, JUAN J. GUCCIONE, AND CHRISTIAN VALQUI 

Consequently \_C k , j^EC^] a ^ 0, and so, by items (2) and (3) of Proposition 1.9, 



and 



C k ,-EC 3 
k 



1 



= VpACn + v Pt<T \^EC'j -ip + a) 
= (k + j)v p ^(C)+v p . a (E) ~{p + a) 



(1.16) 



C k ,-EC 3 
k 



p,<7 



C k ^EC 3 



C\-E 



C J 



(1.17) 



= li P Alc k ,E])e P Acy 



= i P A[c,E\)e P AC) k+ 3-\ 

where the last equality follows from Lemma 1.25. Hence, again by Proposition 1.9, 



c k , \ec ] 



(k+j-l)v Pt(r (C)+v Pt(7 ([C,E]). 



(1.18) 



Combining now (1.16) with (1.18), and (1.15) with (1.17), wc obtain 

v p . A[C,E])=v p AC)+v p AE)-(fi + a) and l Pta {[C, E}) = l p<a {C). 
Hence [C, E] Pi „ = £ p , a (C) ^ 0, and by Lemma 1.25, we have 

[&,E\p,a = t P A[C\E]) = U p , a (Cy-H P A[C,E]) = t£ p , a (Cy = tl Pt „(C t ), 
for all t e IN. □ 



2 The boundary 

In this section we establish an order relation on 23 and then we describe the bound- 
ary of the (convex hull of the) support of an arbitrary element. 

We define an order relation on QJ by setting (p\ , a\ ) < (p, a) if (pi ,a\) x (p, a) > 0. 

To check that < is indeed an order we first verify that that 

(Pi,0"i) < (P,cr) and (p,a) < (pi,0i) => (pi,<n) = (p,cr). 

In other words that (pi,<7i) x (p, a) = if and only if (pi,<7i) = (p,<r). In fact, 
if the cross product vanishes, then (pi,cri) = X(p, a) for some A G Q \ {0}. If we 
write A = m/n with m and n relatively prime, then n(pi,<7i) = m(p, tr) implies 
that m\pi and m\ai, and so m = ±1. We also have n — ±1, since n\p and n\a. 
Finally p + a > and p\ + o\ > imply A = 1. 

We now check the transitivity of <. Assume that 

(P,ct) < (pi,0"i) and (pi,cri) < (P2,0" 2 ). 

This means 

peri — api > and p\<72 — &1P2 > 0. 

Multiplying the first inequality by p2 + (Ji > and the second one by p + a > 0, 
we obtain 

Pipo\ + Oipo\ — piop\ — &2&P1 > and pp\<J 2 + crpio-2 - poi/? 2 - va\P2 > 0. 
Summing up the two inequalities we arrive at 

(pi + ci)(/9cr 2 - ap 2 ) = pipcr 2 + cr 1 pa 2 - P\op2 - o x ap2 > 0, 
and so (p, a) < (p 2 , 02) ■ 
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We can extend the order relation to all of 23 by setting 

(1,-1) < (p,a) < (-1,1) for all (p,a) G 9J. 
Note that if (p, a), (pi<Ji) G 23 and {(p, cr), (picri)} ^ {(1, -1), (-1, 1)}, then 
(pi,<7i) < (p,cx) (pi,cn) x (p,a) > 0. 




Definition 2.1. Let P e \ {0}. We define the set of valuations associated with 
P as 

Val(P) := {(p,a) 6 23 : # Supp(V(P)) > 1}. 
and we set Val(P) := Val(P) U {(1, —1), (—1, 1)}. We make a similar definition for 

PeL\{0}. 




Val(P) = {(1, -1), (2, -1), (2, 1), (1, 3), (1, 0), (-1, 1)}. 



Figure 7. Definition 2.1. 



For each (r,s) 6 Z x Z \ Z(l,l) there exists a unique (p, cr) 6 23 such that 
v p ,a{r, s) = 0. In fact clearly 



(P,<7) := 



ifr-*>0, 



.(a.-a) ifr-*<0, 
where := gcd(r, s), fulfills the required condition, and the uniqueness is evident. 

Definition 2.2. For (r, s) e Z x Z \ Z(l,l), we define val(r, s) to be the unique 
(p, cr) £ 93 such that v PiCr (r, s) =0. 

Remark 2.3. Note that if P G W \ {0} and (p, cr) G Val(P), then 
(p,cr) = val(en PiCT (P) - st Pi<T (P)). 
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Our aim is to prove Proposition 2.8, which geometrically means the following. We 
start at w(P), draw a ray straight with slope 1, and rotate this ray counter-clockwise 
until it hits another point in Supp(P). We break the ray here and continue the 
counter-clockwise rotation of the ray until it hits a new point in Supp(P), etcetera. 
We finish this process when we reach W(P). Each straight segment of the border 
of the support of P are the points where the function v p ^ a takes its maximum, for 
a uniquely determined (p, a) G 23. Similarly, each corner is the point where the 
functions v p _ a take its maximum, for all (p, a) with (pi,ai) > (/?, <r) > (p2,o~2), 
where (pi,a±) and {p2i&2) are the valuations corresponding to the adjacent sides 
of the corner. It is also geometrically clear that the cndpoint of one side is the 
starting point of the next. 

We fix P G W \ {0} and (p,a) G 23. We set en := en Pi<7 (P) and st := st Pi(7 (P) 
and we consider the following two sets of valuations 

Valsup p a (P) := {val((i, j) - en) : (i, j) G Supp(P) and v_ M > u_ M (cn)} 

and 

Valinfp^P) := {val((i, j) - st) : G Supp(P) and vx _i > Vi ,-i(st)} . 




Pairs involved in the definition of 

Valsu Pp;CT (P). 



Pairs involved in the definition of 
Valinf^(P). 



Figure 8. Illustration of the concepts of Valsup p (T (P) and Valinf (9 , cr (P). 



Lemma 2.4. The following assertions hold: 

(1) If{pi,o-i) G Valsup (9jCT (P), then (pi,ai) > (p,a). 

(2) //(pi,<7i) G Valinf p , (T (P) ; then (pi,ai) < {p,a). 

Proof. We only prove item (1) and leave the other one to the reader. Clearly, if 

{i, j) G Supp(P) and v p ^(i,j) = v Pta (P), 
then (i,j) G Supp(^ Pj(T (P)) , and so v-i^{i,j) < u_i4(en). Consequently, if 

(i, j) G Supp(P) and j) > V- lt i(en), 

then w PjCT (i,j) < v p ^(P) = v Pi(J (en). This means 

v Pi(T (a,b) < 0, where (a, b) :— (i,j) — en. 
Note that V-\^{i,j) > w_i ; i(en) now reads 

b — a = w_i ; i(a, b) > 0. 

But then 

(pi,<ri) := val((i, j) - en) = val(a, b) = A(6, -a), 
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for some A > 0. Hence 



> v Pt<T (a, b) 
— ap + ba 

= -^(o-ip-pio-) 

This yields (p,<r) x (pi,<7i) > 0, and so (pi,cri) > (p,cr), as desired. □ 
Lemma 2.5. Le£ P ; (p, <r), st and en oe as before. We have: 

(1) G Supp(P), (p^cri) > (p,a) and < u_i,i(en), t/ien 

^WiCm) ^ *Wi( en )- 
Moreover, if(pi,ai) ^ (—1, 1), i/ien equality holds if and only if(i,j) = en. 

(2) If(i,j) G Supp(P), (pi,<7i) < (p,ct) andv 1 - 1 (i,j) < wi_i(st), i/ien 

Moreover, if (pi, a{) ^ (1,-1), £/ien equality holds if and only if (i,j) — st. 



level lines of w 




pi, a 



1 X 
Figure 9. Item (1) of Lemma 2.5. 



Proof. We prove item (1) and leave the proof of item (2), which is similar, to the 
reader. Set (a, 6) := (i,j) — en. Then, by the hypothesis, 

p<7i — api > and 6 — a < 0. 

Hence 

feptTi + apia — apai — bapi < 0, (2.2) 
and the equality holds if and only if b = a. We also know that v p ^(i,j) < u Pj(T (en), 
which means that pa + ab < 0. Since pi+ai > 0, we obtain 

pipa + aicrb + piab + oipa = (pa + ab)(pi + ui) < 0. (2.3) 

Summing up (2.2) and (2.3), we obtain 

> ppia + a crib + poib + apia = (p + (j)(pia + (Jib), 

and so v pi )<7l (a, b) < 0, as desired. Moreover, if the equality is true, then (2.2) is 
also an equality, and so 6 = a. Hence = v pi , ai (a,a) = (pi + ai)a, which implies 
that a = or (pi,ai) = (—1,1). Thus, is (pi,<7i) ^ (—1,1) and equality holds 
in (2.1), then (i,j) — en. □ 
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Definition 2.6. If Valsup p CT (P) ^ 0, then we define 

Succ PjCr (P) := min(Valsup p(T (P)) 

and if Valinf Pi(7 (P) ^ 0, then we define 

Pred p , CT (P) := max(Valinf p , CT (P)). 

Lemma 2.7. The following assertions hold: 

(1) Succ p , CT (P) G Val(P) and en p , ff (P) = st SucCpAP) (P). 

(2) Prcd p , ff (P) e Val(P) and st p , CT (P) = en Predp „ (P) (P) . 



Succ PjCr (P) 




Figure 10. Definition 2.6 and Lemma 2.7. 



Proof. We only prove (1) since (2) is similar. As above we set en := cn p-cr (P). Write 
(pi,(7i) := Succ p-cr (P). By definition, there exists an (io,jo) £ Supp(P), such that 

v-i,i(io,jo) > u-i,i(en) and (pi,oi) = val((i , jo) - en). 
Consequently, 

(*o,.7o)^cn and (en) (Wo). (2.4) 

Hence (pi,ai) ^ (—1,1), since, on the contrary, u piiCTl (en) < w pi;<Tl (io,jo)- We 
claim that v pl , ai (P) = v pi , ai (en), which, by (2.4), proves that (p\,a\) G Val(P). 
In fact, assume on the contrary that there exists (i,j) G Supp(P) with 

v Pl ,v 1 (i,j)>v Pu(ri (en) (2.5) 

By item (1) of Lemmas 2.4 and 2.5, necessarily V-\ t \(i, j) > w_i i i(cn), and so 
(a, b) := (i,j) — cn fulfills b — a > 0. Hence 

(P2,o- 2 ) :=val((z,j) - cn) = val(a, b) = X(b,-a) 

with A > 0. Now (2.5) leads to 

< (pi,<Ti).(a, b) 

= ^(P2<7l - 0- 2 p\) 

= j(P2,0- 2 ) X (pi.CTl), 

which implies that (p 2 ,cr 2 ) < (pi,a\). But this fact is impossible, since (pi,ai) is 
minimal in Valsup p(T (P) and (p 2 ,cr 2 ) G Valsup p CT (P). This proves the claim and 
so Succ Pi<7 (P) G Val(P). 

Finally we will check that en = st pi)(7l (P). For this, it suffices to prove that 
any G Supp(^ Plj(Tl (P)) fulfills v\-\{i,j) < wi j _i(en) or, equivalently, that 
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v~i,i(i,j) > w_i ; i(en). To do this we first note that by item (1) of Lemma 2.4 we 
have (pi,<ri) > (p,cr). Since G Supp(P) and (pi,oi) ^ (—1,1), from item (1) 
of Lemma 2.5, it follows that if V-i t \(i,j) < u_i i i(en), then v pliVl < v Plj(Tl (en), 
which is a contradiction. □ 

Proposition 2.8. Let P G VF\{0} and let (pi,oi) > (p2,o- 2 ) consecutive elements 
in Val(P). The following assertions hold: 

(1) If(p!,ai) G Val(P) and(p!,ai) > (p,<r) > (p 2 ,a 2 ), then 

(pi.CTl) = SuCCp, CT (P). 

(2) If(p2,o- 2 ) G Val(P) and (pi,<7i) > (p,<r) > {p2,o- 2 ), then 

{p 2 ,o- 2 ) -Prcd p , ff (P). 

(3) 7/(pi,<Ti) > ((0,0-) > (p 2 ,cr 2 ) ; i/ien 

{st Pl , ffl (P)} = Supp(^ ;CT (P)) = {en P2 , CT2 (P)}. 




Figure 11. Proposition 2.8. 



Proof. (1) By item (1) of Lemmas 2.4 and 2.7 it is clear that the existence of 
Succ PiCr (P) implies 

(p,<r) < Succ P!ff (P) and SucCp, ff (P) G Val(P). 

Hence (pi,cti) < Succ Pi(T (P). So we must prove that SucCp j(T (P) exists and that 
(Pijfi) > SucCp i(T (P). For the existence it suffices to prove that Valsup Pj(T (P) / 0. 
Assume on the contrary that Valsupp CT (P) = 0. Then, by definition 

v-i,i(hj) < U-i,i(erip ;CT )(P) for all G Supp(P). 

Consequently, since (p, o) < (pi,<7i) < (—1, 1), by item (1) of Lemma 2.5, 

Supp(^ 1;(ri (P)) = {enp, CT (P)}, 

and so (pi,<7i) ^ Val(P), which is a contradiction. 

Now we prove that (pi, cti) > Succ P!(T (P). Since (pi, <7i) is the minimal element of 
Val(P) greater than (p, er), it suffices to prove that there exists no (p3, 03) G Val(P) 
such that SucCp i(T (P) > (p3,er 3 ) > (p,o-). In other words that 

SucCp^(P) > (p 3 ,CT 3 ) > (p,ct) (p 3 ,a 3 ) £ Val(P). 

So assume that Succ PiCr (P) > (^3,0-3) > (p, <r) and take (i,j) G Supp(£p 3!0 - 3 (P)). 
We assert that (i, j) = enp j(T (P), which shows that Supp(£ P3y(T3 (P)) = {cn P;(T (P)}, 
and consequently that (p3,C3) ^ Val(P). In fact, if v-i^{i,j) < w_i ! i(enp j(T (P)), 
this follows from item (1) of Lemma 2.5, applied to ((03,03) instead of (pi,ci). 
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Assume now that > w_i i i(en PiCr (P)). Since, by item (1) of Lemma 2.7, 

we know that sts UC c p „(P){P) = cn Pi(T (P ), we have 

vi,-i(i,j) < v 1 - 1 (en Pi<T (P)) = v 1 - 1 (st SucCpAP) (P)). 

Hence, applying item (2) of Lemma 2.5, with Succ Pj(T (P) instead of (p, a) and 
(p3,crs) instead of (pi,a\), and taking into account that £ Supp(^ P3iCT3 (P)), 

we obtain 

v P3 ,<r 3 (i,j) = Vp 3 ,a 3 (st SucC/> ^ P) (P)). 

Consequently, since (p3, 03) 7^ (1, —1), it follows, again by item (2) of Lemma 2.5, 
that — st SucCp ct (p)(P) = en PjCT (P), which proves the assertion. 

(2) It is similar to the proof of item (1). 

(3) We first prove that if (pi,cri) £ Val(P), then 

{st pl;CTl (P)} = Supp(V(^))- 

Since {en P;(J (P)} = Supp(^ P;(J (P)), this fact follows from item (1) and item (1) of 
Lemma 2.7. This conclude the proof of the first equality in the statement when 
(pi,<7i) < (—1,1). Now, a symmetric argument shows that if (p2,02) > (1,-1), 
then 

{en P2lCT2 (P)} = Supp(V(^))- 

Assume now that (pi,<7i) = (—1,1) and (p2,o'2) 7^ (1, — 1). Then, by item (1) of 
Lemmas 2.4 and 2.7, we have Valsup(p2, 02) = 0. Hence 

V- 1A (i,j) < u_i a (cn P2iCT2 (P)), 

for all € Supp(P). Consequently, en P2:(T2 (P) G Supp(f_i i i(P)) , and so 

st_i,i(P) = en p2iCT2 (P) + (a, a), 

for some a > 0. But necessarily a = 0, since a > leads to the contradiction 

(st-i.i(P)) (P) + (a,a)) — v p2,(?2 (P) + a {P2 + 02 ). 

Thus 

{st pl , ffl (P)} = {en P2 , CT2 (P)} = Supp(^ iff (P)). 

Similarly, if (pi,«ri) ^ (—1,1) and {p2,ci) = (1,-1), then 

{st Pl , ffl (P)} - {en P2 , ff2 (P)} = Supp(^ ;<T (P)). 

Finally we assume that (pi,<7i) = (—1, 1) and (p 2 , er 2 ) = (1, —1). Since Val(P) = 0, 
it follows from Lemma 2.7 that 

Valsu Pp!ff (P) = = Valinf p , ff (P). 

Hence 

u_i,i(P) = u_i,i(en„ i(7 (P)) and wi,_i(P) = Ui,_i(st p , a (P)). (2.6) 

But, since en Pj(T (P) = st PiCT (P), it follows easily from (2.6) that P = ^_i i i(P), and 
so, 

{em^tP)} - { W (P)} - {w(P)} = {st_i,i(P)} - Supp(V(P)), 
as desired. □ 
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3 Irreducible pairs 

The aim of this section is to introduce the concept of irreducible pairs and to 
establish some of its basic properties. 

Definition 3.1. We say that an endomorphism of W is irreducible if 

v 1 , 1 (il>(X))>2, v 1A (iP{Y))>2 

and there are no (fii,(j>2 S Aut(W) such that 

vi,i(4no1>ofa(X)) + vi,i(0io^o^ 2 (y)) <v 1A (tP(X)) +v 1A (iP(Y)). 

A pair (P, Q) of elements of W is said to be irreducible if there is an irreducible 
endomorphism of W such that 0(A) = P and 0(F) = Q. Note that this implies 
that [Q,P] = 1. 

Remark 3.2. Clearly if (Q, P) is irreducible, then (P + Ap, Q + Aq) is also for all 
Ap, Aq G if. In fact, it is obvious that 

vi,i(P + X P ) =«i,i(P) and «i,i(Q + Aq)=vi,i(Q) 

since ^i,i(P) > and Ui l i(<5) > 0. In particular 

wi,i(P + A P )>2 and « M (Q + Aq) > 2. 

Now, let and 0' be the endomorphisms of W- 7 defined by 0(A) = P-> ^00 = <3 
and 0'(A) = P + Ap, 0'(F) = Aq, respectively. There are no 0i,</> 2 G Aut(W), 
such that 

wi.i (0i o V' o 02 (A)) + w M (0! o 0' o < v hl (tp'(X)) + v hl (0'(Y)) , 

since this implies that 

vi,i(4>i o 4) o 4> o 4> 2 (X)) +vi A (4> 1 oip o cj)o (f> 2 (Y)) < v lt i(i/}(X)) + v ltl (ip(Y)), 

where <j) e Aut(W) is defined by <j)(X) = X + \ P and <j)(Y) = Y + A P , which 
contradicts the fact that (P, Q) is irreducible. 

Theorem 3.3. If there is no irreducible endomorphism, then every endomorphism 
ofW is an automorphism. 

Proof. Assume we have an endomorphism of W, which is not an automorphism. 
Let P = 0(A) and Q = i>(Y). Suppose we have chosen with Wi,i(P) + «i,i(Q) 
minimal. Since, by hypothesis, is reducible, then necessarily Wi ; i(P) = 1 or 
vi,i (Q) = 1- We can assume that ui i i(P) = 1. Hence P = A + AiA + \ 2 Y with 
Ai / or A 2 7^ 0. Let <j> be the automorphism of W defined by 



(j)(X) = P and ij)(Y) 



'x^Y ifAi^O, 
-X^X ifAi=0. 



Clearly <j> 1 o 0(A) — A, and so 

o 0(F), X] = o 0(F), r 1 o 0(A)] = 1. 

But this implies that (fr 1 oi/j(Y) —Y belongs to the centralizer of A, which is A [A]. 
Hence, there exists p G K[X] such that o0(Y) = Y +p(X). From these follows 
easily that o is an automorphism. Consequently is also an automorphism, 
which is a contradiction. □ 

Next we begin the study of the irreducible pairs. We will need the following two 
lemmas. 
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Lemma 3.4. Let (p, a) G 23 and P,Q G W \ {0} . If 

Supp(^, CT (P)) = and Supp(£ p ^(Q)) = {(u,v)} , 

with & (u,v), then 

Supp(^, CT ([Q, P])) = {(» +j - l,u + v - 1)} . 

Proof. By Proposition 1.18. □ 

Lemma 3.5. IfP,QeW satisfy [Q, P] = 1 and w{P) = (0, 1), then P = fiY with 
fieK x . 

Proof. Note that P *> Q ; since P ~ Q leads to = (0, fc) with fc G M . But then 

fi,-i(Q) < 0, which by Remark 1.13, implies vi^i([Q, P]) < 0, a contradiction, 
since [Q,P] = 1. Consequently, by Proposition 1.12, we know that w(Q) = (1,0). 
Now, we will assume that Supp(P) ^ {(0, 1)} and we will arrive at a contradiction. 
Since (0, 1) = w(P) we have Supp^i ,_i(P)) = {(0, 1)}. Hence P ^ £i,-i(P) and so 
Val(P) ± 0. Take (p,a) := minVal(P) and set A := cn p , (T (P). By Proposition 2.8 
we know that 

(0, 1) - w(P) = eni,_i(P) = st p , CT (P), 

and so 

A ^(0,1) and (A) = v P!<T (0,l) = a. 
We claim that (p, cr) < (1,0), or, cquivalently, that a < 0, and hence p > 0. In 
fact, each (i, j) G Supp(P) \ {(0, 1)}, satisfies j — i > 1, since w(P) = (0, 1). In 
particular 

A=(i,i + k) with i > and fc > 1. (3.1) 

Then 

pi + cr(z + fc) = u p , CT (A) = v Pt<T (0, 1) = (J. 
Hence, (t(1 — k) = i(p + cr) > 0, which implies cr < 0, since k > 1, proving the claim. 



w(P) 




A = en Pi<7 (P) 



Figure 12. Shape of the hypothetical P with Supp(P) ^ {(0, 1)}. 



Now set B := en PiCT (<5). Note that A ^ (0, 0), since 

- «i,_i(«;(P)) - ui,_i(0, 1) = -1, 

and P ^ (0,0), since 

v p ,a(B) = v p . a (Q) > v p . a (l,0) = p>0. 

We claim that A B. On the contrary, since A ^ (0,0) and B ^ (0,0), there is 
A > such that XB = A. But this implies 

v p . a {A) = \v p . a {B) > 0, 

which contradicts that v Pi<T (A) = a < 0. Let (pi, <7i) G 33, such that 
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" (Pl,0-l) > 0,cr), 

- (pi,o"i) < min{((p', cr') G Val(P) such that (p',0 7 ) > (p,cr)}, 

- (pi,<7i) < min{((p',<T') G Val(Q) such that (p',<r') > (p,cr)}. 
By Proposition 2.8, 

Supp(^ 1;(7l (P)) = LA} and Supp(^ 1;(7l (Q)) = {£?}. 

Since A jB, by Lemma 3.4 we have A + B = (1, 1). But this is impossible, because 
of (3.1). □ 

Proposition 3.6. Ifip is irreducible, then v Pi(T (ip(X)} > and v Pi(T (ip(Y)} > for 
all (p, cr) G 2T. 

Proo/. Let (p, cr) G 2J, P = VPO and Q = -0(F). We will prove that u p , CT (P) > 
and leave the proof that v p ^{Q) > 0, which is similar, to the reader. We divide the 
proof in three cases. 

First case. (1,-1) < (p, a) < (1,0). By definition this means that p > —a > 0. 
Since p = a = is impossible, necessarily p > 0. Suppose that v PtCJ (P) < 0. We 
claim that Ui ; _i(P) < and vi-i(Q) > 0. The first inequality follows from the 
fact that vi _i(X^') = i -j < for all G Supp(P), since 

p(* - i) + (P + °)j = P* + <?.] = v p , a ( xiYj ) < => P(i - j) < 

^v 1: _ 1 {X t Y 3 ) =i- j < 0. 

It remains to prove that v\ t -i(Q) > 0. In fact, otherwise vi t -i([Q, P]) < (which 
contradicts [Q, P] = 1), since Pi = Qi = for i > and [Q , Po] = by Remark 1.8, 
where Pj and denote the i-homogencous components of P and Q> respectively. 
We assert that 

P = A + P with AoGJCandF / Q. (3.2) 

If P no Q, then we can take A = 0. Hence, we can assume that P ~ Q, which 
combined with vi t -i(P) < and vi t -i(Q) > gives w(P) = (0,0). Consequently 
P = A + P with A G K x and ui_i(P) < 0. This implies that P oo Q and 
hence w(P) = (0, 1) (since Ui,_i(P) < and io(P) + w(Q) = (1, 1) by item (1) of 
Proposition 1.12). Now, by Lemma 3.5 we have Ui,i(P) = 1 and so (P,Q) is not 
irreducible. On the other hand we know by Remark 3.2 that (P, Q) is irreducible, 
which leads to the desired contradiction. 

Second case. (1,0) < (p, a) < (0,1). This means that p, a > 0. It is evident that 
v P m(A) > for all A G W \ {0}, and that the equality holds if and only if A G if x . 
Consequently, v Pi<J (P) > 0, since [Q,P] = 1 implies P ^ if x . 

Third case. (0, 1) < (p, a) < (—1,1). This means that a > — p > and the proof is 
similar to the one of the first case. □ 

Proposition 3.7. Let (P, Q) be an irreducible pair and let (p, a) G 23. Then 

[P,Q] p> a = 0. 

Proof. We will prove that for all (p, cr) G QJ, 

0<w p , ff (P)+« p , ff (Q)-(p + ( T). (3.3) 

This will prove the proposition, since v Pi<T ([P, Q]) = 0. If (p, cr) G {(1, —1), (—1, 1)}, 
then Proposition 3.6 guarantees (3.3). Hence we can assume p + cr > and will 
prove (3.3) in the four cases 

(p,a)<(l,0), (1,0) < (p,<7) < (1,1), (l,l)<(p,cr)<(0,l), (0,1) < (p,cr). 



24 



JORGE A. GUCCIONE, JUAN J. GUCCIONE, AND CHRISTIAN VALQUI 



If {p,°~) < (1,0), then a < and so p > 0. Since, by Proposition 3.6 we have 
vi-i(P) > 0, there exists (i, j) E Supp(P) such that i — j > 0. But then 

v p ,<t(P) > pi + oj = (p + cr)j + j)p >(i- j)p > p > p + o. 
Similarly v p>(r (Q) > p + a, and so (3.3) follows, since p + a > 0. 

If (1,0) < (p,a) < (1,1), then p > a > 0. Since Ui,i(P) > 2, there is a pair 
(r, s) G Supp(P), such that r + s > 2, and so 

"p,<t(-P) > rp + s<7 = (r + s)a + r(p - a) > (r + s)a > 2a. (3.4) 

Moreover, since Wi,o(Q) > by Proposition 3.6, there exists E Supp(Q) with 
i > 0, and so 

Vp,„(Q) >ip + jcr > p. (3.5) 
Combining (3.4) and (3.5), we obtain 

Vp,a{ p ) + v pAQ) > p + 2a> p + cr. 

The third case is similar to the second case and the fourth case similar to the first 
case. □ 

Proposition 3.8. If ip is irreducible, then 

gcd(wi,i(P),wi,i(Q)) i Ki(P),vi,i(Q)}. 

where P := ip(X) and Q := ^>(Y). 

Proof. If this false, then 

wi,i(P) I viAQ) or w M (Q) | wi,i(P). 

Assume that vi y i(P) | i>i,i(Q). By Propositions 3.6 and 3.7, the hypothesis of 
item (2) of Theorem 1.22 are fulfilled. Hence there exist Ap, Aq G K x , m, n £ 1ST 
with gcd(m,n) = 1 and a (1, l)-homogeneous polynomial R E i, such that 

to vali j i(P) 



n vali j i(Q)' 
Consequently to = 1 and 



?i,i(P) = A P P m and £i,i(Q) = \ Q R n . 



r.i,i(Q) = X Q^jp-) n = WAP)" = ^i,i(AP"), (3.6) 



where A = Aq/A p and the last equality follows from Proposition 1.9. Let <j> be the 
automorphism of W defined by 4>(X) — X and 4>{Y) = Y — XX n . We have 

and 

«i,i(^o0(r)) =«i i i(q-ap") <«i,i(Q) = «i,i(V'(i r )), 

where the inequality holds by (3.6), which contradicts the fact that the endomor- 
phism ip is irreducible. □ 

Remark 3.9. If (P,Q) is an irreducible pair, then Val(P) = Val(<3). In fact, if 
(p, o) G 2J, then by Proposition 3.6, Proposition 3.7 and item (2) of Theorem 1.22 
there exist Ap,Aq G K x , m,n g I and a (p, cr)-homogeneous polynomial R E L, 
such that £p. a (P) = Api? m and £ PtCr (Q) — AqP™. The assertion follows from the 
evident fact that 

(p, a) E Val(P) lp.a(P) is not a monomial 
<=> R is not a monomial 
C-p.a(Q) is not a monomial 
(p,<7) G Val(Q). 
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Consequently, by item (1) of Lemma 2.7 and item (1) of Proposition 2.8, for all 
(p, a) £ 23, we have 

Succ p , a (P) exists ==> Succ p . a (Q) exists and Succ PjCr (Q) = Succ PiCr (P); 

and similarly for Predp^. 

We resume the properties of irreducible pairs (P, Q). 

Proposition 3.10. Let (P,Q) be an irreducible pair and (p,cr) £ 23. Then we can 
find a (p, a) -homogeneous element C £ W , Xp, Xq £ K x and n,m £ IN such that 

(1) v Pt(T (C) > and £p, a (C) ^ (£ p ,*(D h ) for all D £W, (£ K x and h>l, 

(2) e p , a (P) = X P £ P AC m ), 

(3) i P AQ) = \ Q i P Ac n ), 

(4) gcd(n,m) ^ {n,m}. 
Moreover 

m = Vp,a(P) = Vl,l( P ) (o 7] 

n v P AQ) v 1A (QY [ " ' 
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Figure 13. Proposition 3.10. 



Proof. By Proposition 3.6, we know that 

v p >,a>(P) > and v^'(<9) > 

for all (p 1 , a') £ 23. We will use again and again this fact freely throughout this 
proof. Arguing as in the proof of Proposition 3.8 we find Xp, Xq £ K x , m, n £ IN 
and a (p, cr)-homogcncous polynomial R £ L, such that 

e p><r (P) = \ P Er and £ p ,a-{Q) = XqR". 

Write 

R = XR k with X £ K x and k maximal. 

Let C := where ^ is the map introduced at the beginning of Section 1. 

Since £ p ^(C) = R, it follows immediately from Proposition 1.9 that C fulfills the 
second part of item (1). Now, since 

t P A p ) = ~ X P RTh = ApA fc i? fe ™ and £ P AQ) = A Q iT - X Q X k R kfl , 
the same proposition shows that C fulfills items (2) and (3) with 

Xp = XpX k , Xq = AqA* , m = km and n = kn. 
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Hence v p ^{C) = -^v p , a (P) > 0, and so the first part of item (1) is also fulfilled. 
Since 

v P ,<r(P) = mv Pt a(R) and v Pi<T (Q) = nv Pl<T (R), (3.8) 

we have m/n — v P:lJ (P)/v p ^ a (Q). It remains to prove that item (4) also holds. 
By (3.8) and Proposition 3.8 it suffices to check equality (3.7). In order to do this 
it is sufficient to show that if 

(pi.CTl) < (pV) < (p 2 ,0- 2 ), 

where (pi,a\) and (p2,o"2) are consecutive elements in Val(P) = Val(Q), then 

(QY 

Arguing again as in the proof of Proposition 3.8 we find X' p , X'q E K x , to', n' G IN 
and a (p 1 , a' )-homogeneous polynomial R' G L, such that 

£ p ,^(P) = \' P R' m ' and t p >, a >{Q) = \' Q R' n ' . 

Note that R' is a monomial since (p',cr') Val(P). Write Supp(P') = {(a, b)}. By 
Proposition 2.8, 

{en pl , ffl (P)} = {st P2 , CT2 (P)} = Supp(V, CT ,(P)) = {m'(a,b)} 

and 

{en pliCTl (Q)} = {st P2 , CT2 (Q)} = Supp(V, CT '(0)) = {n'(a,b)}. 

Hence 

v P ',a'(P) =m'(p'a + a'b), v p .^{Q) = n'{p'a + a'b), 
v Pi,<n{P) = m'(pia + aib), v piiai (Q) = n'^ia + erio), 
v P2,cr 2 (P) = m'(p 2 a + a 2 b), v P2i(T2 (Q) = n'(p 2 a + a 2 b), 
from which (3.9) follows immediately. □ 

Remark 3.11. Note that from items (1) and (2) of Proposition 3.10, Remark 3.6 
and items (4) and (5) of Proposition 1.9, it follows that, for any irreducible pair 
(P, Q) and any (p, a) G 23, 

st p , ff (P) + (0, 0) ± st p , a (Q), st p , ff (P) ~ st Pt „(Q), 

en PjCT (P) ^ (0, 0) ? en p , CT (Q), en Pi(T (P) ~ en p ^(Q). 



4 "Fixed points" of (p, <x)-brackets 

The aim of this section is to construct F G W such that [F, P] P , CT = f-p,a(P) and 
[P, <3] p ,<x = £ P ,<j(Q) for irreducible pairs (P, Q) and some given (p, a) G 23. 

Lemma 4.1. Let m,n £ I. // gcd(n, to) = 1, i/ien for all r > ran — n — m there 
exist a, b > such that na + mb = r. 

Proof. There exist a, b G Z such that r + n + m~an + bra. We can assume that 
< a < to. Then an < ran < r + n + ra, and so b > 0. Hence a := a — 1 and 
b := b — 1 satisfy the thesis. □ 

Lemma 4.2. Lei to, n, r G IN. If c — gcd(n, to) and c = gcd(c, r), then there exist 
a,b>0 such that c = gcd(an + bm, r). 
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Proof. There exist a, b > and a, (3 > such that c = an- bra and c = ar — /3c. 
Let fc be such that kr > b and set 6 := fcr — 6 > 0. A direct computation shows 
that 

c = r{a + m/3k) — (an + 6m)/3, 
Hence gcd(an + bm,r) divides c. But, since c = gcd(c, r) and c = gcd(m, n), we 
have that c divides an + bra and r, and soc = gcd(an + bra, r). □ 

Theorem 4.3. Let (p, a) G 2J and C eW such that 

v p . a {C)>Q and £ p ^{C) ^ (£ p ^{D h ), for all D G W , ( G K x and h > 1. 
If there exist n, to G IN and A,B E W such that 

(1) v(^) = 

(2) =£ P AC m ), 

(3) c := gcd(n,TO.) ^ {n,TO,} ; 

(4) ^, i<7 (L4,.B]) = \l p . a (C h ), for some h G Mo and X e K x , 
then there exist D G V^, ^ G K x and k,j G IN, such that 

{D,C k } p , a = u£ p ^(C k +i°). 

Proof. Take A and £? satisfying the hypothesis of the statement with c minimum. 
Set 

mi := m/c, m := n/c, L> := A mi - B ni 

and 

X := I D = D Q + ^2 K]A % B J eW : in + jra < cn x ra\ and Ay G if I. 
We claim that each Del satisfies 

b]) = mi \e P Ac nmi - n+h ) (4.i) 

and 

V([A A]) = n 1 A£ p , CT (C m " 1 - m+/l ). (4.2) 

In fact, this is true for Do since, by Proposition 1.9, Lemma 1.25, and items (1) 
and (4), we have 

e p , a ([Do,B}) =£ P A[A m \B\) = mi \£ p , a (C nm i- n+h ). 

and similarly 

e p>a ([D ,A]) = ni X£ p .4C mn ^ m+h ). 
In particular D ^ 0. So, in order to establish (4.1) and (4.2), it suffices to show 
that 

v p ^([A l B\B]) < (n mi -n + h)v p ^(C) 

and 

v p ^([A l B j , A}) < (mm -ra + h)v p ^{C), 

for all i, j such that in + jra < n^ra^c. But this follows from the fact that, again 
by Proposition 1.9, Lemma 1.25, and items (1), (2) and (4), 

l p ^[A l Bi ,B]) = £ p A[A\B]Bi) = i\£ p AC m+mi - n+h ) 

and 

l p ^[A l B^A]) = l p .M l [B ] ,A]) = ]\£ p AC m+m ^ m+h )- 
Now, by Remark 1.13, equality (4.1) implies that for D G X 

v P AD) + v Pia {B) -(p + a)> v p ^(C nmi - n+h ), 
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and so, by item (2), 

v Pt „{D) > v p , a (C nmi - n+h ) - v p , a (B) = (ram -m-n+ h)v p , a (C) (4.3) 

for all D G X. Hence there exists D\ £ X such that v Pi<r (Di) is minimum. We 
have two alternatives: 

[D u B} P!<7 ^0 or [D 1 ,B] p , tr = 0. (4.4) 

Note that 

jo := nmi — n — m + h > c{n\m\ — n\ — mi) = c((ni — l)(mi — 1) — l) > 0, 

since gcd(ni, mi) = 1 and n\, mi > 1 by item (3). Hence, in the first case, the thesis 
holds with k = m and /i = miA, because, by item (2), Corollary 1.19 and (4.1), 

[Di,C m ] P .a = [Di,B] Pta = mi X£ p , a (C nm '- n+h ). 

Assume now that [Di,B] p><7 = 0. We are going to show that this alternative is 
impossible, because it implies that c is not minimum. In other words, that 

(*) there exist A,B£ W, A G K x and n, fh, c, h € M with c < c, such that (1), 

(2), (3) and (4) hold, with A, B, A, n, fh, c and h instead of A, B, A, n, m, 

c and h respectively. 

With this purpose in mind, we claim that there exist Ai e K x and r G IN, such 
that 

i p ,a{Di) = \iZ p , a {C r ), r < mmic, r>c and c\r (4.5) 

In fact, by Corollary 1.19 and item (2), we know that [D\, C m ] p . a — [D\, B] PiU = 0, 
which by Lemma 1.25 implies that [Di,C] Pj(T = 0. Hence, by item (2) of Theo- 
rem 1.22, there exists R = t p , a (R) G L, (, £ G K x and r,s£l, such that 

£ P ADi)=(R r and e p>a (C)=SR?. 

Besides, by the conditions required to C, it must be s = 1 and so, by Proposition 1.9, 
(- P .a{D\) = ^£ p ,o{C r ), which proves the equality in (4.5) with Ai := j^. Moreover 

rv p .AC) - v p<a {D x ) < v P!(T (D ) = v p . a {A mi - B ni ) < n imi cv p ^(C), 
where the last inequality follows from the fact that, by items (1) and (2), 

i P AA mi ) - t P Ac cnimi ) - £pAB ni )- 

Thus r < n\m\c. Note that by (4.3) and the equality in (4.5), 
rVpAC) = v P A D i) > ( nm i - m-n + h)v PyCr (C) > c(toitii - mi - n\)v Pt „(C)- 
Hence 

r > c(m\ni — mi — n\) = c((mi — l)(ni — 1) — l) > c, (4-6) 

where the last inequality holds, as before, because mi,ni > 2 and mi ^ri\. Next 
we will prove that c does not divide r. Assume on the contrary that c\ r. By 
Lemma 4.1 and the first inequality in (4.6) there exist a\,b\ > such that 

r 

a\n\ + Oirai = -. 

c 

Consequently 

din + b\m — r < cn\m\, 

and so D 2 := D\ — XiA ai B bl G X. Moreover, since by items (1) and (2), and the 
equality in (4.5), 

x^pAA^b 1 ^) - x 1 £ P Ac ain+him ) = x^Acn = ipADi), 

we get w p ,<t(I?2) < v p ^(Di), which contradicts the minimality of v Pi(T (Di). Thus c 
does not divide r. 
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Set c := gcd(c, r) and A := j^-Di- By (4.5), we know that 

where n := r > c > c. Moreover, by Lemma 4.2 there exist a, o > 0, such that 
gcd(r, an + bm) — c. Note that a > or b > 0, because c ^ r. In particular 
c < c < min(n, m) < an + 6m. Let i? := A a B b . By Proposition 1.9 and items (1) 
and (2), 

where fh := an + bm. So, in order to verify that (*) holds, it only remains to 
establish (4). But, since, 

Xi[A,B] = [D 1 ,A a B b ] = [D u A a ]B b + A a [D 1 ,B b }. 

and, by Proposition 1.9, Lemma 1.25, items (1) and (2), and equalities (4.1) 
and (4.2), 

e Pi<r ([Di,A a ]B b ) = an 1 \l p ^{C 11l+c{mini - mi - ni)+h ) 

and 

i p ^{A a [D 1 ,B b \) = bm 1 X£ Pia (C fh+ < mini - mi - n ^ +h ), 

we have 

e p , a ([A,B]) = \C~ h , 

with 

A := -^-(ani + bm\) ^ and h :— fh + c{m\n\ — m\ — n\) + h > 0, 
Ai 

as desired. □ 
Corollary 4.4. Let (p, a) G QJ and let C eW such that 

v p . a (C)>0 and i p , a (C) + Cl p . a {D h ) for all D G W , ( G K x and h G IN . 
If there exist n,m € I and A,B such that 

(1) i p ,M) = e P Ac n ), 

(2) l„AB)=l P AC m ), 

(3) c := gcd(n,m) ^ {n,m\, 

(4) i p> „{[A,B\) = \i p , a (C h ), for some heM a and X e K x , 
then 

Supp(^, ff (C))^{(j,j)} for all j. 

Proof. Assume on the contrary that £ Pi(7 (C) — dx^yi for some d G K x and some 
j € ISTo- By Theorem 4.3 there exist D eW, p e K x , k e and j G IN" , such 
that [Z),C fe ] Pi(T = p,C k+ ^° . By Corollary 1.19, we can assume that D is (p,a)- 
homogeneous. Write D = ^d rs X r Y s . Since, by Remark 1.13, 

[d rr X r Y r ,d k X kj Y k: >} = 

and, by Lemma 1.7, 

£ p>rT {[d rs X r Y s , d k X kj Y kj }) = (s - r)kjd r ,d!'x r+ki - 1 y s+ki - 1 for all r ^ s, 
we have 

t P A[D, d k X kj Y kj ]) = J2(s - r)kjd ra d!'x r+kj - 1 y' +ki - 1 (4.7) 

r^s 

On the other hand, by Proposition 1.9 and Corollary 1.19, 

e p A[D,d k X ki Y ki ]) = l P A[D,C k \) = fie p AC k+i °) = nd k+jo x^ k+j ^ j y^ +j ^ j , 
which contradicts (4.7). □ 
Theorem 4.5. Let (P, Q) be an irreducible pair and let (p, a) G 23. 
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(1) If{p,&) i Val(P), then v 1 ^ 1 (t p , IJ (P)) ^ 0. 

(2) Wl ,_ 1 (st p , (7 (P))^0 ; 

(3) There exists a (p, a) -homogeneous element F G W, such that 

[P,F} p , a =e p<a (P) and [Q,F] Pia = ^ Pia {Q), 
where £ = v p ^(Q)/v p , a (P). Moreover v Pjt7 (F) = p + a. 



1 




1 X 



Figure 14. Theorem 4.5. 

Proof. By Proposition 3.10, there exist C G W, Ap,Ag G K x and n,m e K such 
that 

(1) v p ^{C) > and £ p , a (C) ^ (t p ,a( Dh ) for all D G W, ( G if x and /i > 1, 

(2) ^ iff (P) = \ P l p , a (C m ), 

(3) V(<2) = X Q l P AC n ), 

(4) gcd(n,m) ^ {n,m}. 

Thus, the conditions of Theorem 4.3 and Corollary 4.4 are fulfilled with 

A := -!-Q, B := -5-P, h := and A := — ^— . 
Aq Ap ApAq 

In particular, if (p, a) ^ Val(P), then Supp(^ P;<J (C)) = {(«,.?)} with i ^ j, and 
so, Supp(^ (9 , cr (P)) = {(mi, mj)}. Item (1) follows immediately from this fact. In 
order to prove item (2), we note that, by item (3) of Proposition 2.8 there exist 
(p',c') < (p, cr) such that Supp(£ p ', CT / (P)) = {st Pi(T (P)} and so, by item (1) 

Vl,_l(stp l(J (P)) = Vl,_l(V,a'(P)) ^ 1 

We now prove item (3). By Theorem 4.3, there exist D G W, p. G K x and fc, jo € IN, 
such that 

[P,C7 fc ] p , ff =pC fe +-' , 

and so, by Theorem 1.26, there exists a (p, er)-homogeneous element E G VK, such 
that 

[C, E\ Pt<T - tl p AC 1 ) for all i G IN. 
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Hence, by Corollary 1.19, 

[P,E\ Pt „ = [X P C m ,E] Pta = m£ p , a (\ P C m ) = mi p , a (P) 

and 

[Q,E] p ^ = [\ Q C n ,E] p , a = nl p A\ Q C n ) = nl p AQ). 
If we set F :— ^E, then we have 

[PF] P ,* = t p ,„{P) and [Q,4 ff = ^UQ)' 
Note now that v p ^ a (P) = mv Pia (C) and v Pi(T (Q) = nv p ^ a (C), and so 

_ _n _ Vp,g(Q) 

m v p . a (P)' 

Finally, it is clear that [P, F) p , a — £ PtCr (P) implies v p , a (F) = p + a. □ 

Proposition 4.6. Let (p, a) G 23, Zei P,Fe W\ {0} and iei /f,p,<t and /p l(9l(7 &e as 
in Definition 1.20. Assume that F is (p, a) -homogeneous and [P,F] Pj<T = l PtCJ {P). 
Then fF, P ,a is separable and every irreducible factor of fp, p , a divides f P , P ,a- 

Proof. By item (1) of Theorem 1.22, there exist h > and c G Z, such that 

a^/p = c/p/f + axf' P f F - bxf' F f P , 

where a := v p , a (F), b := v Pi<T (P), f P := f PiPi<7 and jV := /f, p ,<t- Hence, the pair of 
polynomials (f P , fp) satisfies PE(1, 0, a, 6, c). Since /p the result follows 

from Proposition 1.24. □ 

5 Irreducible pairs and subrectangular elements 

In this section we prove that each irreducible pair can be transformed into an 
irreducible pair whose elements are subrectangular. 

Lemma 5.1. Let Ai G W \ {0} (i = 0,...,n) and let (p,a) G 9J. Suppose that 
there exists q G Q such that v p ^(Ai) = q for all i and set A := J27=a ^i- Then 

A^O and v p ^{A) = q «=► J^p^A) ± 

i 

<=^A^Q and £ p , a (A) =Y^ l pA A i)- 

i 

Proof. This is clear since the isomorphism of if- vector spaces ^: W — > L, intro- 
duced at the beginning of Section 1, preserves the (p, <r)-degree. □ 

For ip G Aut(VF), we will denote by ipi, the automorphism of L defined by 
<p L {x) := *{<p{X)) and <p L {y) := 

Proposition 5.2. Let (p,a) G 23, A G if and 95 an automorphism of W. In any 
of the following cases: 

(1) P G W \ {0}, (p, a) = (p, 1), tp{X) =X + \YP and <p(Y) = Y, 

(2) P G W \ {0}, (p, a) = (1, a), ip(X) = X and <p(Y) = Y + XX ° , 
we have 

e p , a (<p(P)) = ip L {t P A p )) and v pA<p(p)) = v P AP)- 

Furthermore, in the case (1), 

£pi,oi (P) f or all (1, — 1) < (pi,°~i) < (P) c), 

and, in the case (2), 

(<P(P)) = 

(P) for all (p,a)<(p 1 ,cr 1 ) <(-l,l). 
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Proof. We prove (1) and leave (2), which are similar, to the reader. By item (3) of 
Proposition 1.9, 

v pA (p(X l Y^)) = iv pA (X+\YP)+jv pA (Y) = pi+j = Vp^X'Y*) for all i,j e K . 
Hence 

v p ,i(<p(P)) = v Ptl (P) for all P e W \ {0}, (5.1) 

since ip is bijective and therefore induce and isomorphism between the gradations 
associate with the (p, cr)-nltrations. We fix now a P g W \ {0} and write 



P = kX r - i Y s+lp + R, 



7=0 



where R = or v Pt \{R) < v p ,i(P). By (5.1), Lemma 5.1 and item (2) of Proposi- 
tion 1.9, 



= e pA (^2 x i( x + \Y p ) r - l Y s+lp ^j 

n 

= M>,i((* + \Y p y- i Y s + i p) 

i=0 
n 

i=0 

= <p L (£ pA (P)), 

as desired. Let (pi,a\) e 2J such that (pi,cti) < (p, 1). Then p\ > po\, and so 

£ Puai {X + XYP) = x. 

Hence, by Proposition 1.9, 

l Puai {p{X l Yi))=t puai ({X + \Y p yYi) = xW 

and 

v pu<yi {p{X l Yi)) = i Pl +ja 1 = v puai (X^), 
which implies that 

Wi (¥>(#)) =Wi CB) ioi al\ReW\{0}. (5.2) 
Fix now P e W \ {0} and write 

P = ]T hjX l Y 3 + R, 

{(i,j):pii+<rij=v P1 ,„ 1 (P)} 
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with R = or v pl ^ 1 (R) < v pl ^ 1 (P). Again by (5.1), Lemma 5.1 and item (2) of 
Proposition 1.9 

v ij 

i,3 

— £pi,m {P)i 

as desired. □ 

We let CH(£>) denote the convex hull of a subset D of R 2 . 
Remark 5.3. Let (p,a) G 23 and let A G W \ {0}. Note that if 

7 

l p ,a(A) = a t x r - ta y s+tp with a 7^ and a 7 ^ 0, 

i=0 

then 

CH(Su PP (^ ff (A))) = {A(r, s) + (1 - A)(r - 7 a, s + 7 p) : < A < 1}. 
Note that by Proposition 1.9, 

CH(Supp(^, CT (A*))) = {Xt(r, s) + (1 - A)t(r - 7a, s + 7/3) : < A < 1}. (5.3) 
for all t G IN. 

Remark 5.4. Let (p, cr) G 2J and P, F G W \ {0}. Assume that F is (p, cr)-homoge- 
neous and that [P, F] P , CT = £ P m(P)- Since v Pj(T (F) = p + cr, 

Supp(F) C R p>(7 = {(x,y) e R 2 : xp + ya = p + cr}, (5.4) 

where R p , a := {(1, 1) + t(-a, p) : t G R}. 

Proposition 5.5. Lef P, F and (p, cr) fee as in Remark 5.4- Set 

V := CH(Supp(^ P!(T (P))) and Conc(P) := {tu : t > 0, t G R and u G P}. 
We Ziaue 

{st p , CT (F), cn P!ff (P)} C (Cone(P) n F P , CT n IN 2 ,) U {(1, 1)}, 
where P PjCr is as above. 

Proof. For the sake of brevity we will write st(P) and en(P) instead of st p . (J (P) 
and en A<T (F), respectively. By Remark 5.4, we know that Supp(P) C F A<T , and 
so {st(P),cn(P)} C R pcr n IN 2 ,. We claim that if one of st(P) or en(P) is not 
in Cone(P), then it is equal to (1,1). For this, note that st(P) ~ st(P) implies 
st(P) G Conc(P). Consequently, from item (1) of Proposition 1.17 and the fact 
that [P,F] P!(T =e p!a (P) it follows that if st(F) £ Conc(P), then st(P) = (1,1). A 
similar argument works for en(P). □ 

Lemma 5.6. Let P, F and (p, cr) be as in Remark 5-4- If F is a monomial, then 
(p, cr) £ Val(P) and F = pXY for some p G K x . 
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Figure 15. Proposition 5.5. 



Proof. Write 



(P) = J2 \x r ~ ia y s+lp with A , A Q ± 0. 



By Definition 1.15, the equality [P, F] P;Cr = 1 P m(P) implies v p ^(F) = p + a. Hence 
there exists j £ Z such that 

P = pX^Y 1 ^" . 

Now, by Proposition 1.18, 

a 

[P,P] P , CT = ^MiM^ r - (<+j)CT 2/ s+(i+J> , 

i=0 

where 

Hi = (1 - jcr)(s + ip) - (1 + jp)(r - zcr) = (s - r) - j(rp + so) + i(p + a). (5.5) 
Consequently, 



(5.6) 



i=0 



Since 



and 



i=0 



MA;MiZ r - (i+j) V +(i+J> J < r - s - j(p + a), 
from equality (5.6), it follows that necessarily j < 0. Similarly, since 

v-i,i *iX r - ia y S+ip ^J =s-r + a(p + <j) 

and 

w_i,i [Y^pX^x^+^y^+^P ) < s -r + (a + j)(p + a), 



i=0 



THE DIXMIER CONJECTURE AND THE SHAPE OF POSSIBLE COUNTEREXAMPLES 35 



necessarily j > 0. Hence F = pXY and equations (5.5) and (5.6) become 

Pi = (r - s) - i(p + a) (5.7) 

and 

a a 

mA*M^ m V +v = A^ M V +v - (5.8) 

i=0 i=0 

Consequently, p = Pa, which, by (5.7), implies that a = 0. □ 
Proposition 5.7. Let P, F and (p, a) be as in Remark 5.4- We have: 

(1) If (p, a) = (1, 1), then Supp(P) C {(2, 0), (1, 1), (0, 2)}. Moreover, 

- if (0,2) G Supp(P), then (0,1) G Supp(£ p . CT (P)) for some I G IN, 

- i/ (2,0) G Supp(F), then (1,0) G Supp(^ CT (P)) for some I G IN. 

(2) If p > cr > and (p, a) G Val(P), thenar 1, Supp(P) = {(1,1), (0,1 + p)} 
and (0,0 G Supp(^ PiCr (P)) /or some Z G IN. 

(3) //cr > p > and (p, cr) G Val(P), then p = 1, Supp(P) = {(1, 1), (1 + cr, 0)} 
and (Z,0) G Supp(£ Pi<7 (P)) /or some Z G IN. 

Consequently, the polynomial fp,p,a, introduced in Definition 1.20, satisfies 

- deg(/ F .i,i) < 2, 

- deg(/ F , M ) = 2 and only if {(2, 0), (0, 2)} C Supp(P), 

- ifa>p>0orp>cr>0, then deg(fF, P ,a) = 1- 
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(a) Case p = a = 1 

Figure 16. 
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(b) Case p > a > 

Proposition 5.7. 



Proof. Note that if (1, 1) + t(-a, p) G INg, then f G Z, 1 - crt > and 1 + tp > 0. 
Since cr, p > 1 we obtain that 



1 < --<*<-< 1- 

p cr 



(5.9) 



Hence 



(1,1) +t(-a,p)€ M 2 



tG {-1,0,1} ifp = cr = l, 
tG{0, 1} ifp>cr>l, 
iG{-l,0} ifcr>p>l. 
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Consequently, by Remark 5.4, 

f {(2,0), (1,1), (0,2)} if p = - = 1, 
Supp(F) C } {(1, 1), (1 - a, 1 + p)} if p > a > 1, 
[{(l,l),(l + a,l-p)} if<7>p>l. 

This finishes the proof of the first part of item (1). Moreover, by Proposition 5.5, 
we know that if (0, 2) G Supp(P), then (0, 2) G Conc(P), and so 

(0, /) G Supp(^, CT (P)) for some I G IN, 

and similarly if (2,0) G Supp(F), then (1,0) G Supp(^, CT (P)) for some Z G IN. Now 
we prove item (2). By Lemma 5.6, if (p, a) G Val(P) then F is not a monomial, and 
so (j = l. Moreover, again by Proposition 5.5, we know that (0, 1 + p) G Cone(P), 
and so (0, 1) G Supp(£ PiCr (P)) for some / G IN. The proof of item (3) is similar. □ 

We will now see how the different automorphisms of W affect the shape of P 
(and hence also of Q). We will consider only two types of automorphisms (which 
are shown in [8] to generate all automorphisms of W). They are the maps 

$™,a : W -> W and < A : W -> W, 

defined for all A G K and n G IN, by 

<5> n ,x(Y)=Y and = X + XY n 

and 

K,x(X) = X and $; ;A (F)=F + AX", 

respectively. 

Corollary 5.8. Let (P,Q) be an irreducible pair and let (p, cr) G Val(P). Take C, 
m and n be as in Proposition 3.10. We have: 

(1) If p > a > 0, then a — 1 and there exists A G K such that the automorphism 
Lp := $ p ,-a ofW, satisfies 

(a) £ p ,i(<p(P)) = p P x tm y sm and t p ,i(<p(Q)) = p Q x tn y sn , where s G N , 
t = deg(/c,p,i) > and pp,pq G K x . 

( b ) ^i,<ti(^(-P)) = l Pu <n{P) and £ pll<Tl (<p(Q)) = £ Pl ,a 1 (Q) f or al1 (Pi.^i) 
such that (1, —1) < (pi, cti) < (p, 1). 

(2) If g > p> 0, i/ien p = 1 and there exists A G K such that the automorphism 
(p := $^ _ x ofW, satisfies 

(a) 4, CT (^(P)) = fi P x tn y sn and *i,„(p(Q)) = p Q x tm y sm , where t G W , 
s = deg(/c,i, CT ) > and /z P , p Q e K x . 

(b) ^ 1;<Tl (^(P)) = ^ l!ffl (P) ond^^^Q)) = £p 1>CTl (Q) /or a// (pi,^) 
smc/i i/iai (1, cr) < (pi, (Ti) < (—1, 1). 

Proof. We prove item (1) and leave the task to prove item (2) to the reader. Let F 
be as in item (2) of Theorem 4.5. By its very definition we know that /f,p,i(0) / 0. 
Hence, by Lemma 5.6 and Proposition 5.7, 

(j = l and /f,p,i = Pf{^x + 1) with A G if x . 

Thus, by Proposition 4.6, there exist pp G if x and j G IN such that 

/p,p,i = pp{\x + \y . 

Consequently, there exist k, u G 1N , such that 

£ pA (P) = a:V/p, P ,i(ic" V) = MpzV(AaT V + l) j = p P x k - j y u (\y» + x? . 
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Note that k > j, since £ p .i(P) is a polynomial. Since, by item (2) of Proposition 5.7, 
there exists I G IN such that 

(0,/) e Supp(*p,i(P)), 

we have k = j. Hence, by item (1) of Proposition 5.2, 

ip,i(<p(P)) = <PL{t P AP)) = i*p* i v u , 

since <pl(Aj/ p + x) = x. We assert that j — mt and u = ms, where s £ Ij and 
t = deg(/c7,p,i) > 0. In fact, since, by Proposition 3.10 and 1.9, 

e p , 1 (P) = \ P e p , 1 (C) m , (5.io) 

we have 

£ pA (C) = m s (Ay" + x) t = J24 t ) V +<p , 

where t = deg(/c, p ,i) > 0, and so, j = tm and u = sm by equality (5.10). Since, 
Val(Q) = Val(P) by Remark 3.9, a similar argument shows that 

l p ,i{ip{Q)) = p Q x tn y sn . 

Finally, item (b) follows from the additional affirmation in Proposition 5.2. □ 

Lemma 5.9. Let P,Q E W. If for some p e K x and r <E 1N , 

p(x + Xy) r for some A 6 K x , 

then (P, Q) cannot be an irreducible pair. 

Proof. We consider first the case £\^{P) = py r . Assume that (P, Q) is an irreduci- 
ble pair, which clearly implies that r > 0. By Propositions 3.10 and 1.9 there exist 
Ap, Aq G K x , C G W and n, m G IN such that 

^i,i(P) = XpiiAQ" 1 and £ hl (Q) = X Q £ 1 , 1 (C) n . 

Hence 

£i.i(Q) - Vi,i(C) n = ^-tiAP)™ = ™ = mV, (5.n) 

A p Ap 

where p' := ^ and s := ^ (note that p! e if x and s G IN). Now, by Remark 3.9 
we know that Val(P) = Val(Q). Let 

(p,er) := max{(p>') G Val(P) such that (p',</) < (1,1)}. 

By definition (p, a) < (1, 1) means that p > a. We claim that a > (in particular 
p + er > and so (p, a) G Val(P)). Let 

(p",ct") = min{(p',o-') G Val(P) such that (p,<r) < (p',a')}. 

Since (1,1) ^ Val(P), necessarily (p, <r) < (1,1) < (p",er"). Hence, by Proposi- 
tion 2.8, 

{en p , ff (P)} = Supp(4,i(P)) = {(0,r)} (5.12) 

and 

{en p , CT (g)} = Supp(4,i(Q)) = {(0, *)}. (5.13) 
Consequently, by Proposition 3.6, 

ro- = v p . a (0, r) = v p ^(P) > 0, 
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which implies that a > 0. Now, it follows from item (1) of Corollary 5.8 that a = 1 
and there exists ip := & p ,-\, such that 

£ pA {ip{P)) = p P x tn y ln where i £ H, i e 1N , «ei and p P E K x . (5.14) 

Consequently, 

(0,v Ptl (<p(P))) £Supp(^(P)). (5.15) 
In fact, if (0,v p> i(ip(P))) E Supp(<p(P)), then from 

v pA (0,v pA (<p(P))) =v Ptl (<p(P)), 

follows 

(p,v Pll (tp(P))) eSupp&.iMP))), 

which contradicts (5.14). On the other hand, by Proposition 5.2 and equali- 
ties (5.11), (5.12) and (5.13), we have 

v p>1 (<p(P)) = v Ptl (P) = v p>1 (0, r) = r = « m (aV) - t>i,i(P) (5.16) 

and 

v P MQ)) = w p ,i(Q) = Wp,i(0, s) = a = ^i^V) = vi,i(Q) (5.17) 
Moreover, for each E Supp(<p(P)), 

v^X^) =i+j<pi+j = v^iX'Y^ < v Ptl (<p(P)), (5.18) 
and, for each E Swpp(tp(Q)), 

v 1A (X l Y>) = i+j< P i+j = v pA (X l Yi) < v pA (<p(Q)). (5.19) 

Since p > 1, the equality in (5.18) is only possible if i = and j = v Pi i(<p(P)). 
Thus, by (5.15), (5.16), (5.17), (5.18) and (5.19), 

v 1A (ip(P)) < v lt i(P) and v 1A (ip(Q)) < v M (Q), 

which shows that (P, Q) is not irreducible. The proof in the case £i,i(P) — px r is 
similar. Finally, we consider the case £i t i(P) = p(x + Xy) r with A E K x . Assume 
that (P, Q) is an irreducible pair and set <p :— $i,-a- By item (1) of Proposition 5.2, 

px r = p L (p(x + Xy) r ) = p L (£i,i(P)) = h,i(<p(P)), (5.20) 

v 1A (<p(P)) =«i,i(P) and v 1 , 1 (<p(Q))=v 1 , 1 (Q). (5.21) 

Now, from (5.21) it follows easily that (ip(P) , ip(Q)) is an irreducible pair, which 
by (5.20) contradicts the previous case, finishing the proof. □ 

Lemma 5.10. Assume that (P,Q) is irreducible. If 

£i,i(P) = px r y s with p E K x and r,s£l, 
then Supp(P) C : i < r and j < s}. 

Proof. Let E Supp(P). We prove that j < s and leave the proof that i < r, 
which is similar, to the reader. We take 

(p, a) := minjV, a') E Val(P) such that (p , a') > (1, 1)}. 

By definition this implies that p < a. Since (1, 1) ^ Val(P), 

(p",a")< (1,1) <(p,a), 

where 

(/?", a") = max{(p', a') E VaT(P) such that (p' , a') < (p, a)}. 
Hence, by Proposition 2.8, 

{st p , CT (P)} = Supp(4,i(P)) - {(r, *)}. (5.22) 
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We claim that (p, a) > (0, 1). Otherwise < p, which by item (3) of Proposition 5.7, 
implies p = 1 and 

(Z,0) G Supp(4 i<7 (P)) for some Z e IN. (5.23) 
Now by (5.22) and (5.23), we have 

r + as = v li<T (P) = vi i<T (l, 0) = I, 

and so 

Vi,i(P) > 0) = I = r + as > r + s 

since a > 1. But this contradicts Ui,i(P) = r + s and so proves the claim. Then 

(p",a")< (1,1) < (0,1) <(p,a), 
and consequently, by Proposition 2.8, 

{st 0l i(P)} = Supp(*i,i(P)) = {(r,*)}. 

Hence, 

s = v ,i(r,s) = v ,i(P) > v ,i(i,j) = j, 
as desired. □ 

Theorem 5.11. Let (P,Q) be an irreducible pair. Then there exist pp,pQ £ K x , 
a, b 1 to, n£K and ip £ Aut(W) such that to, n > 1, gcd(m, n) = 1, 1 < a < b and 

£MP)) = vpx am y bm , tiAviQ)) = mq^V", 

wi,i(¥>(P)) ^ "i,i wi,i(v(Q)) = wi,i(Q)- 
Furthermore <p(P) and <p(Q) are subrectangular and the pair (ip(P) , ip(Q)) is irre- 
ducible. 

Proof. We claim that there exist p £ K x , r, s £ IN and G Aut(W) such that 

VWP))=Fy, w 1; i(^(P))=w 1 ,i(P) and wi,i(¥>(g))=wi,i(Q). 

By item (2) of Theorem 4.5 there exists a (1, l)-homogeneous element F £ W , such 
that 

[P,P]i,i =4,i(P) and [Q^-'P]!,! =4,i(Q), 
where £ = Ui,i(P)/ui,i(Q). By item (1) of Proposition 5.7, we know that 

Supp(F)C{(2,0),(l,l),(0,2)}. 
So we have the following cases: 

(1) Supp(P)-{(2,0)}, 

(2) Supp(P) = {(0,2)}, 

(3) Supp(F) = {(l,l)}, 

(4) Supp(F) = {(l,l),(0,2)}, 

(5) Supp(F) = {(2,0),(l,l)}, 

(6) Supp(F) = {(2,0),(0,2)}, 

(7) Supp(F) = {(2,0),(l,l),(0,2)}. 

If F is a monomial, then, by Lemma 5.6, Supp(P) = {(1, 1)} and (1, 1) ^ Val(P). 
Consequently, the first two cases are impossible and, in the third one, 

t\,i{P) = V xr y a witn A* e K>< and r ; s e INo- 

Note that by Lemma 5.9, necessarily r, s > 0, and so we can take <p = id. By its 
very definition, in case (4) 

/f,i,i = Pf(^x + 1) with /xp, A G if x . 

Hence, by Proposition 4.6, there exist p,p £ K x and r, f G IN such that 

/p,i,i = M-^a; + l) r and /q^i = p(Aa; + l) r . 
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Consequently, there exist k, k,s,s G Mo, such that 

£ M (P) = aV /p,i,i(* -1 w) = ^y^Xx^y + l) r = ^x k - r y s (Xy + x) r 

and 

£ M (Q) = a; S |/ 8 7o,i,i(a:" 1 ») = fixh^^y + if = M^ _ V(Ay + x) f . 
Note that fc > r and k > f, since ^i,i(P) and £i,i(Q) are polynomials. By item (1) 
of Proposition 5.7, there exists I £ M such that (0,Z) G Supp(^i i i(P)). So, k = r 
and thus Ui,i(P) = r + s. Similarly k — f and Vi ! i(P) — f + s. Hence 

£ 1A (P)= fi(\y + x) r y s and h,i(Q) = M(Ay + xfy s . 

On the other hand, by Lemma 5.9, necessarily s > 0. Set ip := $i,_a- By Pro- 
position 5.2, 

lix r y s = y L {n{x + Xy) r y s ) = M*i,i{P)) = *iMP)) 

and 

flx f y s = <p L (fi(x + \yfy s ) = <p L (ti,i(Q)) = h,i{y{Q))- 

Consequently 

v li i((p(P)) = r + s = Ui,i(P) and vi tl (<p{Q)) = r + s = Ui,i(Q). 

The case (5) is similar. Finally, we consider the cases (6) and (7). By its very de- 
finition deg(/ir i i i i) = 2. Hence, by Proposition 4.6, there exist /j,f, fi, Ai, A2 G if x 
and r, s,f,s£ Mo, with Ai ^ A2, r + s > and f + s > 0, such that 

/f,i,i = Mf(Aix + l)(A 2 a; + 1), 
/p,i,i =M(Aix + l) , '(A 2a; + l) s 

and 

/q,i,i = mxix + iy(\ 2 x + iy. 

So, there exist u,v,u,v £ Mo, such that 

e hl (P) = ^x u y v (X 1 x- 1 y + l) r (A 2 x- 1 y + l) s = fxx u - r - s y v (X iy + x) r (X 2 y + x) s . 
and 

£ M (Q) = jixViX^y + l) r {X 2 x- 1 y + l) s = ^-^y^X^y + X y(X 2 y + x) s . 

Note that u > r + s and u > f + s, since ^1,1 (P) and £i.i(Q) are polynomials. By 
item (1) of Proposition 5.7, there exists I £ M such that (I, 0), (0, 1) £ Supp(4,i(P))- 
So u = r + s and v = 0, and thus Wi,i(P) = r + s. Similarly u = f + s, u = and 
Vi,i(Q) — r + s. Hence 

h,i(P) = fi(X iy + x) r {X 2 y + x) s and h,i{Q) = Ji(X x y + x) f {X 2 y + x) s . 

Furthermore, from Lemma 5.9 it follows that r,s,f,s £ M. Set ip := By 
item (1) of Proposition 5.2, 

hAip{P)) = Mh,i(P)) = ^ r ( x + (M - Ai)y) s 

and 

li,i(ip(Q)) = M*i,i(Q)) = M* r > + ( A 2 - Ai)y) 5 - 

Consequently, 

v hl (iP(P)) =r + s = v 1A (P) and v hl {ip(Q)) = f + a = 

Now set P' := V(P), Q' := ^(<3), A := l/(Ai - A 2 ) and ip' := $' x A . By Proposi- 
tion 5.2, 

£i,i(V'(P')) = ^(4,1(^0) - M(A 2 - Ai) r x* 1 y s 

and 

<i,i(W)) = ^(<i,i(Q')) - m(a 2 - Ax) W- 
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Consequently, 

vi.i(^'(P')) = Vhi(P') = vi,i(P) and wi.i^W)) = v iAQ') = vi,i{Q)- 
So, we can take the automorphism ip := ip' o hnishing the proof of the claim. 
Now the pair (<p(P) , <p(Q)) is irreducible, since 

wi.iMP)) = = (Q) 

and (P,Q) is. Hence, by items (2) and (3) of Proposition 3.10 and item (2) of 
Proposition 1.9 there exist a (1, l)-homogeneous element C G W, Xp,Xq G K x 
and n, m G 1ST, such that 

lix r y s =hMP))=\ P i hl {C) m and h,i(<p(Q)) = VuM" ( 5 - 24 ) 

Let d := gcd(m, n). Replacing C by C d , we can assume that gcd(m,n) = 1. Note 
that, by item (4) of Proposition 3.10, we know that m,n > 1. From the first 
equality in (5.24) it follows that there exists a, b G EST such that 

r = ma, s = mb and £i,i(C) = [iX P 1 x a y b . 

So, by (5.24), 

iiMP)) = ^x ma y mb and *i,i(p(Q)) = \q fi n X P n x na y nb . 

Consequently, by Lemma 5.10, <p(P) and tp(Q) are subrectangular. Furthermore, 
by item (1) of Theorem 4.5, we have a ^ b. Finally, thanks to the existence of an 
automorphism of W that takes X to Y and Y to —X, we can obtain a < b. □ 

Corollary 5.12. If the Dixmier conjecture is false, then there exist P,Q such 
that [Q,P] = 1 and the supports of P and Q are subrectangular but not subsquare. 

Proof. It follows from Theorems 3.3 and 5.11. □ 

6 Computing lower bounds 

In this section we assume that K is algebraically closed. Our purpose in this section 
is to determine a lower bound for the value 

B := min{gcd(wi ! i(P), Ui,i(Q)), where (P,Q) is an irreducible pair}. 

More precisely, we will prove that B > 8. 

Lemma 6.1. Let P G W with wi ; _i(eni i o(P)) < 0. Suppose there exists F G K[Y] 
satisfying 

[P,XF(Y)] lt0 =£ lt0 (P). (6.1) 
Then there is a X G K such that the automorphism ip of W, defined by 

ip(X):=X and <p(Y) := Y + X, 
fulfills ui,_i(sti ;0 (^(P))) <0. 

Proof. Let (a, b) := eni j0 (P). By definition there exists / G K[y], with deg(/) = 6, 
such that £i v o(P)=x a f(y). Moreover, b > a since 

a-6 = ui_i(eni i0 (P)) < 0. 

We claim that there is a linear factor y — A of /, whose multiplicity m\ fulfills 
m\ > a. This is clear if a = 0. So, we can assume that a > 0. A direct computation 
using Proposition 1.18 shows that 

[P,XF(Y)] lfi = [X a f(Y), XF(Y)]ifi = x a {f\y)F{y) - af(y)F'(y)), 

and so, hypothesis (6.1) reads 

f'F - afF' = f. 
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From this it follows that any linear factor of / divides F. Hence, 

#factors(/) <deg(F), (6.2) 
where #factors(/) denotes the number of different linear factors of /. Note that 

en li0 (XF(Y)) = (l,M), 
where M := deg(F). By item (2) of Proposition 1.17, we know that 

(1,M) = (1,1) or (l,M)~em, (P) = (a,6). 
This yields M = 1 or M = b/a > 1. Consequently, by (6.2), 

#factors(/) < b/a. 
Hence, there exists a linear factor y — A of /, whose multiplicity mj fulfills 

^ > dcg(/) > _b_ = a 
~ #factors(/) ~ b/a 
which finishes the proof of the claim. 

Write f(y) := (y — X) mx f(y). By Proposition 5.2, the automorphism ip of W, 
defined by (p(X) := X and <p(Y) := Y + A, satisfies 

t ll0 (<p(P)) = M^,o(P)) = x a y mx 7(y + A). 

Thus sti j o(v(-P)) = ( a , m \), and so, 

vi _i(sti i0 (^(-P))) = a - m x < 0, 
as desired. □ 

Proposition 6.2. For any irreducible pair (P,Q), there exist m,n G IN and an 

automorphism ip ofW, such that m 1 n> 1, gcd(m,n) = 1, 

(1) (Pq,Qo) '■= (' l P(P),' l P(Q)) is an irreducible, 

(2) wi,i(P ) = wi,i(P) and v M (Q ) = 

(3) Po and Q are subrectangular and 

Supp(^i i i(Po)) = (ma, mb) and Supp(£\ t i(Qo)) = (na,nb), 
for some a, b £ IN with a < b, 

(4) vi _i(eni )0 (Po)) < and i>i,-i(eni )0 (<9o)) < 0, 

(5) Ui,-i(sti, (Po)) < and i>i,-i(sti, (<9o)) < 0. 
Moreover, there exists (p,cr) := Predi i o(Po), and 

(a) a < 0, 

(b) [Qo,P ] = l, 

(c) (p,a) e Val(P )nVal(Q ), 

(d) Wp !(T (Po) > and v p ^(Q a ) > 0, 

(e) [Po,QoW = 0, 

/f\ fp, g (-Po) _ m 
V ' f Pl<7 (Qo) n ' 

(g) vi _i(en Pi(7 (Po)) <0 and _i(en (9iCT (Q )) < 0. 

Proof. By Theorem 5.11 there exist /Up, /Uq 6 if x , a, 6, to, n e IN and V'l £ Aut(W) 
such that m, n > 1, gcd(m, n) = 1, 1 < a < b and 

hAMP)) = »px am y bm , iiAMQ)) = v Q x an y bn , (6.3) 

wi,i(V>i(P))=«i,i(P), wi,i(^i(Q))=wi,i(0)- (6-4) 

Furthermore 

- the pair (^i(P), ipi(Q)) is irreducible, 
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- tpi(P) an d ipi(Q) are subrectangular. 

Sot 

P i: =Vi(P) and Qi:=MQ)- 
Since Pi is subrectangular and Supp(^i i i(Pi)) = {(am, bm)}, we have 

{(am,bm)} C Supp(4 i0 (Pi)) C {(am,j) : < j < bm}. 

Hence, 

eni j0 (Pi)) = (am, 6m), and similarly eni j0 (Qi)) = (an,bn). 

Consequently, by the first equality, 

Ui i _i(eni ; o(Pi)) = wi _i(am, bm) — m(a — b) < 0. 

On the other hand, by item (3) of Theorem 4.5 there exists a (1, 0) -homogeneous 
element F\ such that 

[P,Pi]i,o =4,o(P) and «i, (Fi) = l. 

This implies that F\ — XF(Y) with F G lf|Y]. Hence, by Lemma 6.1, there exists 
A G K such that the automorphism ip of W, defined by 

95(X):=X and p(y) := Y + A, 

fulfills 

wi,_i(sti, (¥J(Pi))) < 0. (6.5) 
Aloreover, since by Proposition 5.2, 

liMPi)) - h,i{Pi) = HPX am y bm (6.6) 

and 

tiAviQi)) = iiAQi) = »Qx an y hn , (6.7) 

the pair (Po,Qo) '■= (<£(Pl), ¥>(Qi)) is irreducible. Consequently, by item (2) of 
Theorem 4.5, inequality (6.5) and Remark 3.11, 

vi,-i(sti, (Po)) < and wi,_i(sti, (Qo)) < 0, (6.8) 

while, by (6.6), Lemma 5.10 and Remark 3.9, the elements Po and Qo are subrect- 
angular. Now, arguing as above for (Pi,Qi), we obtain that 

eni j0 (Po)) = (am, bm) and eni ; o(<3o)) = (an, bn), 

and so 

Ui,-i(eni i0 (Po)) < and Ui,_i(eni ;0 (<3o)) < 0. 
Set V := ip o Vi. By (6.4), (6.6) and (6.7), 

«i,i(Po) = «i,i(P) and v 1A (Q ) = Ui,i(<9) 

This concludes the proof of items (1), (2), (3), (4) and (5). As above of Lemma 2.4, 
let 

Valinfi i0 (Po) := {val((i, j) - st) : (i,j) G Supp(P ) and vi _i (i,j) > Vi -i(st)} , 

where st := sti ; o(Po)- Note that Valinfi j0 (P) ^ 0- In fact, otherwise, by item (5), 

«i,-i(Po) =ui,-i(sti ;0 (Po)) < 0, 

which contradicts Proposition 3.6. Let 

(p,<r) = Predi i0 (Po) := max Valinf i,o(Po)- 

Item (a) follows from (p, a) < (1,0), which is true by item (2) of Lemma 2.4. 
Item (b) holds, since (Po, Qo) are an irreducible pair. Item (c) is true by item (2) of 
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Lemma 2.7 and Remark 3.9. Items (d) and (e) follow from Propositions 3.6 and 3.7 
respectively. Now, by Proposition 3.10 and equalities (6.6) and (6.7), 

VpAPp) _ vi,i( p o) _ ™ 

and so item (f) holds, since to, n > 1 and gcd(ra,n) = 1. Finally, item (g) is true 
by item (2) of Lemma 2.7 and item (5). □ 

Proposition 6.3. Let (P, Q) be an irreducible pair and (p, a) G 23. The following 
assertions hold: 

(1) There exist Xp,Xq G K x , m, n G IN and a (p, a) -homogeneous element 
R G L such that m,n > 1, gcd(n, m) = 1 and 

l P AP) = ^pR m and £p, a (Q) = X Q R n . 
Furthermore 

Vp,a{P) _ ViMP) _ rn 
v P ,a(Q) v 1A (Q) n' 

(2) There exists a (p, a) -homogeneous element F G W such that 

[P,F\p,e=lpA P ) and V p AF)=P + <T, 

Moreover, if (p, er) G Val(P) and a < 0, then F is not a monomial and 

en PiCT (F) (1, 1) and en p ^(F) = pen Pt „(R). (6.9) 
where /! G Q and < p. < 1. 
Assume that (p, a) G Val(P) and a < 0, and write 

(r, s) := cn p ^(R) and (f, s) := st P;Cr (i?). 
The following assertions hold 

(3) gcd(r,s) > 1. 

(4) v lfi (en p , a (P)) > 2- 

(5) r > 3. 

(6) If f <s, then gcd(f, s) > 1 and f > 3. 

Proof. By item (2) of Proposition 1.9 and items (2) and (3) of Proposition 3.10, 
there exist a (p, cr)-homogeneous element C G W, Ap, Xq G K x and n, to G IN such 
that 

tpAP) = WpAC 1 ) = x p Rm and tpAQ) = ^q^p,ct(c™) = x Q R n . (6.io) 

where R := £ p , a (C). Let d := gcd(m,n). Replacing i? by R d we can assume that 
gcd(m-,n) = 1. Note that, by item (4) of Proposition 3.10, we have to, n > 1. 
Furthermore, by equality (3.7), item (3) of Proposition 1.9 and (6.10), 

m = v P A p ) = v iA p ) rfiin 

n VpAQ) v hl {QY 
This finishes the proof of item (1). We now prove item (2). By (6.10) and item (5) 
of Proposition 1.9, 

ea p AP) = men p AR) and en PyCr (Q) = n cn p . a (R), (6-12) 

while, by Proposition 3.6 

v P AP) > and v P AQ) > 0. 
Note that from the first inequality above and (6.12) it follows that 

en p AR) + (0,0), en p , CT (P) £ (0,0) and en p , CT (Q) £ (0, 0). (6.13) 
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On the other hand, by item (3) of Theorem 4.5, there exists a (p, cr)-homogeneous 
element F £ W, such that 

[F,P] p . a =£p,AP) and v p , a (F) = p + a. 

Consequently en p ^(F) ^ (0,0). We claim that if (p, a) £ Val(P) and a < 0, then 

crL p ^(F) ^ (1,1) and en Pi<T (F) ~ cn p ^(R). 

In fact, by Lemma 5.6, we know that F is not a monomial, and so en PtCT (F) = (1, 1) 
implies that st Pi<J (F) = (1 + a/p, 0), which is impossible, since from a < and 
p + a > it follows that 1 + a/p Z. Hence, by item (2) of Proposition 1.17, 

en Pi(T (F) ~ en P;CT (P). 

So, by (6.12) and (6.13), we have en PiCT (F) ~ cn A<T (P), as desired. By the first 
inequality in (6.13), this implies that there exists p £ Q such that 

en PiCT (F) = pen Pt(T (R). 

In order to end the proof of item (2) it remains to see that < p < 1. The first 
inequality follows immediately from the fact that en A<T (P) ^ (0,0). We now are 
going to prove that p < 1. Let (p',a') £ 9J such that 

(p', a') < (p", a") for all {p", a") £ Val(P). 

By item (3) of Proposition 2.8 we know that 

{w(P)} = SuMt p ,,„,(P)). 

On the other hand, by item (1) there exists (' £ K y and a (p' , cr')-homogeneous 
element R' £ L such that 

WOP) = C'R' m - 

Hence 

w(P) = (mr',ms') where {(r',s')} = Supp(P'). 
Furthermore r' > s', since «i j _i(P) > by Proposition 3.6. We claim that 

v p ^(r',s') > p + a. 
In fact, if s' = 0, then r' > 1 and so 

v p ,cr{r', s') = pr' + as' = pr' > p > p + a, 

and if s' > 1, then 

v p ,cr(r', s') = pr' + as' > ps + as' = (p + a)s > p + a. 
Consequently, by item (3) of Proposition 1.9 

v P ,a(R) = ^v p ^(P) > ^-v p ^{w(P)) = v PiU (r', s') > p + a, 

and so 

i > P + (T = ^eAEI = iU 

Vp.a(R) Vp^(R) 

proving item (2). Now item (3) is clear, since by equality (6.9), the assumption 
that gcd(r, s) = 1 leads to p £ Z, which contradicts that < p < 1. In order to 
prove item (4) we must show that 

en p , CT (P) = (1, k) and en p , CT (F) = (0, k) 

are impossible. We already know that en p , a (F) ^ (0,0) and en p ^(F) ^ (1,1)- If 
en p>(T (F) = (1, k) for some k ^ 1, then 

p + ka = v p ^(cn p , cr (F)) = v p . a (F) = p + a, 
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and so (7 = 0, which is a contradiction. Similarly, if en Pi<7 (F) = (0,k) with k > 1, 
then 

ka = v p ^(cTLp^(F)) = v Pi a(F) = p + a > 0, 

which contradicts a < 0. We now prove item (5). By the very definition of p,, 

en PjCT (F) = (pr,ps), 

which, by item (4), implies r =/= 0. Hence, again by item (4), we have 

r > pr = ui i0 (en P;Cr (P)) > 2. 

We finally prove item (6). Suppose that f < s. As above of Lemma 2.4, let 

Valinfp^P) := {val((i, j) - st) : G Supp(P) and vi-i > Vi -i(st)} , 

where st := st PiCT (P). Since, by item (4) of Proposition 1.9 and Proposition 3.6, 

t>i,-i(st Pi(7 (P)) =m(f-s) <0 and v 1 - 1 (P)>0, 

we have Valinf P;Cr (P) ^ 0. Let 

(p,a) := Pred p ^(P) := max(Valinf p , CT (P)). 

By item (2) of Lemma 2.7 we know that 

(p, a) G Val(P) and en p ,^(P) = st p , CT (P). 

Now, again by item (1), there exists ( G K x and a (p, a) -homogeneous element 
R G L \ {0} such that 

£p, 9 (P) = CR m . 
By items (4) and (5) of Proposition 1.9 

cn Pt9 (R) = en Pi <r(P) = ^- st Pi<7 (P) = st Pi<7 (P) = (f, s), 

and so, applying items (3) and (5) with (p,a) replaced by (p,a), we obtain that 
gcd(f, s) > 1 and f > 3. □ 

Corollary 6.4. Le£ 

P := min{gcd(wi i i(P), Ui j i(<5)), where (P,Q) is an irreducible pair}. 
Then B > 8. 

Proof. Let (P,Q) be an irreducible pair such that B := gcd(«i i i(P), Wi,i(<3)). Let 
(Po,Qo) and (p, c) be as in Proposition 6.2. Thus, (P ,Q ) is an irreducible pair, 
a < and (p, er) G Val(P ) (~l Val(Qo)- Hence, by item (1) of Proposition 6.3, there 
exists Ap , Aq G K x , a (p, cr)-homogeneous element R e L \ {0}, and to, n G IN, 
with to, n > 1 and gcd(TO, n) = 1, such that 

tpAPo) = ^P«R m , tp.AQo) = A Qo P" (6.14) 

and 

w v p . a (P ) ui,i(Po) 



(6.15) 



n VpAQo) n.iiQo)' 
From the first equality in (6.14) and item (5) of Proposition 1.9, it follows that 

— en p(7 (P ) = en p(7 (P), 

TO 

while equality (6.15) implies that 

gcd(ui,i(P ),«i,i(<9o)) = ^«i,i( p o)- 
On the other hand, by item (2) of Proposition 6.2, 

vi,i( p o) = v hi( p ) and «i,i(Oo)=«i,i(Q), (6-16) 
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and so 

B = gcd(ui,i(Po),«i,i(Qo)) = ^vi,i{Po) > vi tl (en Pi<T (R)) = r + s, 

where (r,s) :— en Pt<T (R). Since, by item (g) of Proposition 6.2, we have r < s, it 
follows from items (3) and (5) of Proposition 6.3, that necessarily r + s > 9. □ 
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